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A Message 


Tammy Allen 
University of South 
Florida 


“Chance favors the connected mind.” — Steven Johnson 


The presidential theme this year is Connections. | 
would like to use this column to reflect a bit more on 
this theme, hopefully highlighting why it is important, 
how it weaves into strategic initiatives and efforts un- 
derway at SIOP, and its potential benefits. Over the 
past several years, SIOP has worked hard to identify, 
demonstrate, and extend its impact. Adrienne 
Colella’s presidential theme focused on the impact of 
l-O psychology while Past-President Doug Reynolds 
used the theme “extending SIOP’s influence” to both 
celebrate past work done within the field of l-O psy- 
chology and to call SIOP members to action on helping 
shape issues outside of our organization. 


So how is the notion of Connections different than 
past themes that pertain to SIOP’s influence? One of 
the key ways in which we increase our influence is 
through the process of initiating, building, strengthen- 
ing, and maintaining connections with others inside 
and outside of l-O psychology. In other words, making 
connections is the “how” behind the “what” (i.e., influ- 
ence) we strive to achieve. One example of building 
new connections to help increase our visibility and im- 
pact is through an initiative currently underway fo- 
cused on identifying ways to strengthen the relation- 
ship between SIOP and local I-O groups for the mutual 
benefit of each. A committee chaired by Bill Farmer is 
doing this work. Local I-O groups provide a conduit for 
connecting with the business community, can serve as 
a communication channel for issues relevant at the 
local level such as licensing, and provide a vehicle for 
extended educational offerings and fellowship outside 
of our annual conference and the LEC. The committee 
is creating a toolkit that can be used to help local 
groups on starting, organizing, and maintaining an or- 
ganization. If you have thought about starting a group for 


October 2013 Volume 51 Issue 2 


l-O psychologists in your area, contact Bill 
to get added to the discussion group 
(farmerwl@flash.net). Another example 
that is focused outside of I-O is our new 
partnership with Lewis-Burke Associates 
LLC, a full-service government relations 
firm located in Washington, DC (see arti- 
cle here). Our relationship with Lewis- 
Burke will play a key role in helping us 
advocate for our science and become 
more visible to external stakeholders. As 
in my last column, | again invite mem- 
bers to get involved in connecting our 
work with others by joining the my.siop 
group for science advocacy. Log in to 
my.siop and find the group entitled, 
“Advocacy Volunteers.” 


The Connections theme is also intended 
to spur thought about the types of syn- 
ergies that facilitate innovation, break- 
through thinking, and ultimately the sus- 
tainability of our field. Dorion Sagan (son 
of famed astronomer Carl Sagan) notes 
that science is about connections and 
states “For me, the great scientific 
satoris, epiphanies, eurekas, and aha! 
moments are characterized by their abil- 
ity to connect.”* Similarly, Steve Jobs 
asserted that producing new concepts 
and ideas resulted from the process of 
relating and connecting things and ex- 
periences.* The very heart of SIOP is the 
connection between science and prac- 
tice, and that connection is what makes 
SIOP unique from many other profes- 


sional societies that primarily focus on 
one or the other. Our connection of sci- 
ence and practice creates an emergent 
collective more significant than either 
on their own. Connection to practice is 
one aspect of the relevance of our sci- 
ence. However, our scientific relevance 
to others in the scientific community 
outside of I-O is also important to the 
facilitation of those “eureka” creative 
moments when new ideas and possibili- 
ties emerge and to our long-term viabil- 
ity.’ One example of this form of intel- 
lectual cross-pollination is the new field 
of study of neuroleadership that com- 
bines research and knowledge from the 
fields of neuroscience and leadership 
and organizational development. This 
notion also ties in with one of the objec- 
tives | outlined at the 2013 closing ple- 
nary, that of mapping our science, and is 
a key aspect of our theme track planning 
for the 2014 conference. 


Comments, questions? You can find me 
on twitter @TammyDAllen or drop me 
an email at tallen@mail.usf.edu. 


‘Sagan, Dorion (2013). Cosmic apprentice: Dis- 
patches from the edges of science. Minneapolis, 
MN: University of Minnesota Press. 

*Beahm, G. (2011). |, Steve: Steve Jobs in his own 
words. Evanston, IL: Agate B2. 

3Ryan, A. M., & Ford, J. K. (2010). Organizational 
psychology and the tipping point of professional 
identity. Industrial and Organizational Psychology: 
Perspectives on Science and Practice, 3, 241-258 
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The Editor’s 
Out-Box 


Morrie Mullins 
Xavier University 


Listening and Learning 


I’ve been told that there’s no such thing as a perfect 
launch, but l'Il be honest—I was pretty pleased with 
the first digital issue of T/P. A lot of people put a lot of 
hours into it, from our writers to our tireless staffers, 
and it gave us a good foundation to continue moving 
TIP into the “digital age.” 


It wasn’t perfect, though, and PII be the first to admit 
there are things we can improve on. That’s why, as you 
start paging through this issue, you’ll see a lot of 
changes. Digital publishing involves a lot more than 
providing dynamic, interactive content and pretty pic- 
tures. It involves paying attention to what the reader 
experience is going to be like, thinking about every- 
thing from the user interface to the choice of fonts. It 
should already be obvious that we’ve been listening to 
the feedback that we’ve gotten and are actively using 
it to improve the reading experience. 


One thing that it’s important to emphasize, right from 
the start, is that we understand that one size does 
NOT fit all, when it comes to digital reading prefer- 
ences. That’s why in addition to offering the e- 
magazine format (from which you can export any arti- 
cle you want as a pdf file), we offer you full .pdf ver- 
sions of each of the major sections of T/P (Features, 
Columns, and Reports) and versions formatted for 
both major e-reader platforms. There are also apps for 
both iOS and Android devices, available through 
(respectively) iTunes and Google Play. You can find 
them here and here, or simply by searching for “3D 
Issue” (the publishing program we use) in the respec- 
tive store. The apps are free to download. I’ve person- 
ally used the iOS app on my iPad and haven’t had any 
trouble with it. (It also allows you to pinch-stretch to 
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zoom, which 3D Issue doesn’t support if 
you’re viewing on a mobile device or tab- 
let without the app.) 


In other words, you have options. 


What other things have we learned, 
through listening to you? One of the big- 
gies has to do with readability. In think- 
ing about our July issue, | wanted to keep 
the layout as generally similar to what 
you were used to as | could, to minimize 
the “transition anxiety.” Well, as it turns 
out, the layout we used in print publish- 
ing didn’t translate well. Single-column 
pages, with a narrow font, work when 
every reader can hold the magazine ata 
preferred distance from their eyes and 
adjust light to their liking but are not the 
height of readability on a monitor or tab- 
let. Combine that with a user interface 
that wasn’t intuitive, with a zoom fea- 
ture that went from “uncomfortably 
compressed” to “ENORMOUS” at a click, 
and the reading experience was, as one 
member put it, more of a “nonreading 
experience.” That’s precisely what we 
don’t want to have happen, but it is 
feedback that we needed to hear. 


So we’ve changed the layout pretty dra- 
matically, moving to a two-column for- 
mat with a more readable font. Shorter 
line lengths plus bolder font should im- 
prove your experience, and we’ve added 
more subnavigation within the issue 
(check out the buttons at the end of each 
column). The great thing about digital 
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publishing is that we have the flexibility 
to keep working at it until we reach a 
place where the greatest number of our 
readers are satisfied. Look for a short 
survey soon, but even before you get 
that please keep sending us your feed- 
back. We need to know what works, and 
what doesn’t. We’re listening and we’re 
learning, and although I can’t take all the 
credit for the things that work well, as 
editor I’m absolutely going to answer for 
the things that don’t. 


And with that, on to the content! 


We’ve got a ton of great material for this 
issue—in fact, there were more Feature- 
scale articles that | could have included, 
but didn’t in order to keep from further 
expanding the page count. | don’t know 
that we have more verbiage than the last 
issue, but the changes in formatting to 
make things more readable give us a raw 
page count that’s among the longest in 
recent memory! 


We start with Tammy Allen’s Presidential 
column, in which she focuses on the 
theme of “connections.” We then get an 
update from Romella el Kharzazi on a 
licensure-related topic reported onina 
prior issue of TIP. Moving into the Fea- 
ture articles, Robert Satterwhite, Erica 
Spencer, Richard Klimoski, Natalie Jen- 
sen, Trent Burner, and Mark Schmit pro- 
vide an analysis of HR from a supply chain 
perspective, Alexandra Livesey and Ilke 
Inceoglu dig into the issues surrounding 
how we assess disabled talent, and Alan 
Colquitt provides an interesting and 
thoughtful analysis of how we might bet- 
ter integrate research and practice, start- 
ing from the familiar “sandbox” of per- 
formance management. Questions relat- 
ing to our identity as a field are also cen- 
tral to Joel Lefkowitz, who returns to 
TIP’s pages to ask us to cast a critical eye 
on all the people we aren’t studying and 
what that might mean. 


Wrapping up the Features, Rob Tett, 
Cameron Brown, Benjamin Walser, Scott 
Tonidandel, and Daniel Simonet con- 
tinue their series of articles on the SIOP 
Graduate Program Benchmarking Survey, 
this time focusing on comprehensive ex- 
aminations, and Daniel Abben and Jane 
Halpert add to the conversation Tett and 
colleagues have been advancing by ex- 
amining what kinds of information I-O 
programs tend to make available on their 
websites. 


In our Editorial Columns, there are a 
couple of important introductions to be 
made. First, I’d like to officially welcome 
the new TIP-TOPics team from Portland 
State University! When | put out the call 
for TIP-TOPics columnists, | was deathly 
afraid that no one would apply, and that 
I'd be forced to ghostwrite columns for 
some fictitious university in the Baha- 
mas for the next 2 years. Quite to the 
contrary, we got a good number of ap- 
plications, and after a thorough review 
by myself and two other selection com- 
mittee members, the team from PSU got 
the job! (There were some fantastic 
ideas from candidates that didn’t get 
selected, so hopefully you'll be seeing 
those ideas in T/P over the next couple 
of years regardless.) The PSU team has 
10(!) members, but this issue’s introduc- 
tory column, which provides some back- 
ground on PSU and “sets the stage” for 
the next 2 years of their contributions to 
TIP, was written by Jenn Rineer, Caitlin 
Demsky, and Tori Crain. 


Also joining TIP starting in October is 
Kristen Shockley, who will be coauthor- 
ing the “Yes You Can!” column on l-Os 
and funded research with Ashley Wal- 
voord. We thank departing columnist Liu 
-Qin Yang for helping get the “Yes You 
Can!” ball rolling, and wish her all the 
best. Their column this month deals with 
funding opportunities for graduate stu- 
dent research, so pairing it with TIP- 
TOPics was only natural. 
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Lori Foster Thompson, Ishbel McWha, 
and Alex Gloss turn their Humanitarian 
Work Psychology “spotlight” on health- 
care in India, in a fascinating interview 
with Drs. Rustin Meyer and Ruth Kanfer 
about their work with CARE, the Coop- 
erative for Assistance and Relief Every- 
where. Back on this side of the globe, 
Eric Dunleavy and Art Gutman fill us in 
on the status of recent EEO challenges 
to the legality of background checks, 
with a commentary by Kevin Murphy to 
cap their report. Tiffany Poeppelman, 
Nikki Blacksmith, and guest coauthor 
Yongwei Yang provide their take on “Big 
Data,” and M. K. Ward and Bill Becker’s 
interview with Dr. Daniel Simons had me 
looking for things | could delete from 
one of my syllabi to make room for it! 


Our various Forums continue to be ac- 
tive, with Tracy Kantrowitz describing 
how the Professional Practice Commit- 
tee is working to build visibility for the 
l-O “brand” and offering a thought- 
provoking conversation with four I-Os 
working in a variety of fields where en- 
hancing our visibility may be particularly 
relevant. Tori Culbertson tackles the 
dreaded academic question of when it 
may finally be time to let a paper you’ve 
worked so hard to get published go to 
meet its fate in the round file in the sky 
(or, you know, that file cabinet in the 
bottom of your closet). Alex Alonso and 
Mo Wang, in their International Prac- 
tice Forum, call on Lynda Zugec and An- 
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gelo DeNisi to talk about SIOP’s Interna- 
tional Affairs Committee’s White Paper 
Series. If you’ve not looked at these, 
they’re very worth your time. 


And it keeps going! Marcus Dickson re- 
turns to Max. Classroom Capacity’s 
roots, talking about technologies that 
can benefit our classroom instruction. 
Now, to figure out how to get my uni- 
versity to order a MicBall.... Paul 
Muchinsky presents “three bold ideas” 
and announces a TIP team member as 
the first-ever coauthor of his textbook! 
Kevin Mahoney looks back over 50 
years of equity theory, Tom Giberson 
and Suzanne Miklos offer a Good Sci- 
ence—Good Practice column focused on 
telecommuting, and Rob Silzer and Chad 
Parson provide a double shot of their 
Practice Perspective, offering data on 
international SIOP membership and up- 
dating data from an earlier column to 
continue investigating whether SIOP 
appropriately values practitioners. 


If that were all we had, we’d still have an 
awful lot. Milt Hakel updates us on 
what’s new with the SIOP Foundation, 
we've got information about SIOP: 
Honolulu from Robin Cohen and Evan 
Sinar, and Thomas Sasso, Katina Saw- 
yer, and Larry Martinez of SIOP’s LGBT 
ad-hoc committee provide a short his- 
tory of DOMA and their thoughts on 
what its repeal means for workplace 
equality. We’ve got a really interesting 


piece from Wendy Becker and Salvatore 
Zappala on licensing issues in Europe, 
news reports from both the SIOP UN 
team (John Scott, Ishbel McWha, 
Mathian Osicki, Deborah Rupp, Lise 
Saari, and Lori Foster Thompson) and 
our representatives to the APA Council 
of Representatives (Deborah Whetzel, 
John Scott, Rodney Lowman, and Lori 
Foster Thompson), an APA update from 
Autumn Krauss, and information— 


including a tutorial video!—about stay- 
ing connected from ECC Chair Zack 
Horn. 


So, there you have it. TIP, volume 51, 
issue 2, in a (1,600-word) nutshell! Keep 
sending \ us your feedback 

(mull ier , or tweet me 

( r), and keep an eye out fora 
TIP. survey later this year. Happy read- 
ing! 


9TH ANNUAL SIOP LEADING EDGE CONSORTIUM 


"LIM VA 
La MO ND, 


There’s still time! 


For more information or to register, 
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Letter to 
the 


Rejoinder: DC Rescinds "Waiver" 
Dear Editor: 


| would like to provide an update to a T/P article pub- 
lished in the January 2010 issue concerning a waiver to 
licensing requirements | had received from the District 
of Columbia. This letter is a rejoinder: DC Rescinds 
"Waiver." 


To protect myself from the possible wrath of the guilty 
(just joking), | will not refer to anyone by name. Sev- 
eral months ago, | was contacted by an attorney for 
the DC Board of Psychology. The attorney sent what | 
perceived to be a nasty-gram to my email inbox. The 
message was a demand that the original T/P article 
concerning my having been granted a waiver be taken 
down as | was granted the waiver "in error." Further- 
more, | was to immediately refrain from referring to 
myself as a "psychologist." After a denied request for 
consideration, | conceded defeat. 


As a result of this experience, | want to share some 
insights and be so bold as to suggest a few things. 


1. Attorneys have more influence on your ability to 
practice your profession than you realize. The Chair of 
the Board deferred to her attorney in interpreting the 
law for when waivers were permissible. Both SIOP and 
APA need to do a better job advocating that lawyers 
who work at state boards must also be degreed psy- 
chologists. 

2. Clinicians still have a clinical bias. SIOP must do a 
better job advocating with APA and local state boards 
that clinicians are not the only type of psychologists 
that exist. Furthermore, SIOP should help its members 
identify opportunities for partnering with clinicians. 
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3. SIOP took no steps to advocate on my 
behalf (and it won't for you either). This 
is because SIOP does not currently have 
the necessary infrastructure in place to 
provide this type of assistance to its 
members. SIOP needs to form a body 
that it members can turn to for assis- 
tance when they encounter such issues 
with state boards; this body would be a 
quasi-ombudsperson. 


Conclusion: In the District of Columbia, 
you must be a licensed psychologist to 
use "psychological" terms in the promo- 


tion of your services or business. SIOP 
needs to develop a simplified policy 
about where it stands on licensure and 
how it will help its membership navigate 
the often choppy waters of state bu- 
reaucracies. 


Thank you for allowing me to share my 
opinions. 


Yours truly, 

Romella Janene El Kharzazi 

(formerly, McNeil) 

PhD in Industrial-Organizational Psychology 
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Introduction 


Over the past several years there has 
been a great deal of interest in the ap- 
parent science—practice gap (Silzer, Co- 
ber, & Erickson, 2010). In particular, a 
number of papers (Bartunek & Rynes, 
2010; Beyer, 1997; Hulin, 2001; Mohr- 
man, Gibson, & Mohrman, 2001; Rynes, 
Giluk, & Brown, 2007) have pointed out 
(and usually lamented) that the latest 
research findings or evidence-based 
practices are not adequately incorpo- 
rated into organizational practice. As 
highlighted by multiple academics, many 
HR practice initiatives do not reflect the 
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best evidence available. Indeed, some 
have argued that a particular HR inter- 
vention or practice (e.g., 360 surveys) is 
rarely based on any empirical evidence 
(e.g., Abrahamson & Eisenman, 2001; 
Kehoe, Brown, & Hoffman, 2012; Tip- 
pins, 2012). 


We agree with evidence-based manage- 
ment (EBM) advocates that organiza- 
tional practices and interventions must 
be both supported by sound research 
and be relevant to the needs of the end 
users (e.g., Rousseau, 2006; 2012). 
Given these considerations, the various 
stakeholders to any proposed HR initia- 


tive would have to engage and dialogue 
in new and meaningful ways in order for 
EBM to succeed. In this regard we be- 
lieve that there are real benefits to view- 
ing the scientist—professional practitio- 
ner—client relationship in terms of a 
“supply chain” partnership (Cronin & 
Bendersky, 2012). 


The supply chain metaphor is being used 
here to envision the potentially fruitful 
outcomes that could stem from better 
relationships among HR stakeholders: 
academics, internal practitioners (e.g., 
HR generalists, talent management spe- 
cialists), external consultants, and end 
users/customers (e.g., managers). Each 
of these stakeholder groups is part of a 
system, one that involves knowledge 
creation, translation, and implementa- 
tion. The supply chain perspective ar- 
gues that each stakeholder group can 
and must work together to ensure that 
collective outcomes are mutually satisfy- 
ing, provide shared benefits, and en- 
hance organizational performance. In an 
ideal supply chain arrangement, aca- 
demics and external consultants would 
tap into internal practitioners and end 
users for a continuous stream of timely 
and relevant research and needs analy- 
sis, which, in turn, would be leveraged 
to build or revise products or services 
that meet the internal practitioners and 
end users’ specific needs, resulting in 
measurable successful outcomes for all 
stakeholders. In short, the supply chain 


approach provides a logical process and 
engenders cooperation among stake- 
holders. Moreover it calls for a continu- 
ous and useful information and feed- 
back exchange loop among HR knowl- 
edge generators, translators, implemen- 
ters, and users. 


We want to recognize that the supply 
chain notion has been used or implied 
recently by thought leaders who seek to 
offer ways to address the key HR chal- 
lenges facing our field. For example, 
Cappelli (2008) highlights the potential 
value of looking at talent management 
in this way. Thus the flow of talent to 
critical areas or at critical times might be 
best accomplished if HR professionals 
saw themselves as “internal talent sup- 
pliers” who must better understand sen- 
ior managers’ (“end users”) needs for 
talent. The various ways of bringing tal- 
ent “online” through programs of inter- 
nal (current employee) development, 
facilitating the onboarding of external 
hires, or even, when called for, the im- 
portation of talent by way of a company 
acquisition can thus be advocated for 
accordingly. Boudreau (Boudreau & 
Ramstad, 2007; Lawler & Boudreau, 
2009) appears to be making similar 
points when he stresses the need for HR 
professionals to become not just 
“business partners” but “strategic part- 
ners” with senior managers or other 
stakeholders. Here, too, the HR profes- 
sional can only hope to play such roles if 
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they engage with or continuously listen 
to their “clients,” usually senior manag- 
ers. AS an example, Boudreau describes 
the efforts of IBM to build and effectively 
use an integrated supply chain for hu- 
man resource and talent management. 


Current Study 


Discussions of some of the symptoms of 
the science—practice gap prompted the 
formation of a working group made up of 
representatives of key HR stakeholder 
groups. One outcome of this work group 
was the decision to conduct a study con- 
trasting the “supply and demand” per- 
spectives of academics, internal practi- 
tioners, external consultants, and end 
users when it comes to HR practice ar- 
eas. Our goal was to highlight where HR 
suppliers—whether academics, external 
consultants, or internal practitioners— 
are succeeding and where they could be 
doing a better job in meeting the needs 
of end users. 


Method 


A survey was developed by the authors 
with input from SIOP and SHRM experts. 
The survey was designed to elicit input 
from different stakeholder groups in- 
volved in the HR supply chain. A random 
sample of 6,000 individuals was identi- 
fied from both SIOP and SHRM’s mem- 
bership databases. Responders were 
asked to self-identify as HR practitioners/ 
internal consultants, external consult- 


The Industrial Organizational Psychologist 


ants, or academics. In addition, a random 
sample of 300 management-level end 
users was obtained from two Fortune 
200 organizations: one global retailer 
and one global specialty eatery. In Febru- 
ary and March of 2013, email invitations 
were sent to participants. The survey 
was accessible for approximately 2 
weeks and e-mail reminders were sent to 
nonrespondents in an effort to increase 
response rates. 


Survey questions covered the following 
six areas: 


Q1: Most important talent management 
issues: Participants were asked to choose 
their top two among nine alternatives, 
including selecting the best talent and 
developing employees 


Q2: Most important areas of HR focus: 
Participants were asked to choose their 
top two among 13 alternatives, including 
leadership development and employee 
engagement 


Q3: Biggest challenges when implement- 
ing talent management systems (e.g., 
selection, 360, performance appraisal, 
succession planning): Participants were 
asked to choose their top two among 
seven alternatives, including senior lead- 
ership support and business unit buy-in 


Q4: Most important element of a suc- 
cessful talent management system: Par- 
ticipants were asked to choose among 


eight alternatives, including business 
linkage and integration with existing 
systems/programs 


Q5: Most important qualities in a talent 
management system: Participants were 
asked to rate the importance of 15 
qualities (e.g., flexibility, legal defensibil- 
ity, efficiency) using a four-point Likert 
scale, with points ranging from very im- 
portant to very unimportant 


Q6: Importance sources of information: 
Participants were asked to rate the im- 
portance of 11 information sources (e.g., 
company HR research department, sen- 
ior operational managers, professional 
scientific conferences) on potentially 
useful/impactful new HR talent manage- 
ment initiatives, platforms, or tools; rat- 
ers used a four-point Likert scale, with 
points ranging from very important to 
very unimportant 


All six questions shared a common stem 
or foundation (which allowed for com- 
parisons across disparate groups) but 
were also tailored in such a way as to be 
logical to respondents’ unique perspec- 
tives. For example: 
1. What are the two most important 
talent management issues... 

i. your organization faces? (HR practi- 
tioners/internal consultants and end 
users) 

ii. your customers/clients face? 
(external consultants) 


iii. you see as rising in importance in 
the research literature? 
(academics) 


Results 


Final participants included: 
< 550 internal practitioners 
(“internals”); 
- 124 external consultants 
(“externals”); 
- 134 academics; and 
- 172 end users (“customers”). 


Descriptive statistics compared differ- 
ences in perspectives among internals, 
externals, academics, and end users of 
HR initiatives. Response frequencies be- 
tween these groups were examined to 
determine differences in the most im- 
portant talent management issues, most 
important areas of HR focus, the biggest 
challenges when implementing talent 
management systems, and the most im- 
portant element of successful talent 
management systems. Respondent im- 
portance ratings on the talent manage- 
ment system qualities and information 
sources were also compared between 
the groups. Results are described in 
more detail below. 


Q1: Most Important Talent 
Management Issues 


When asked to rate the two most im- 
portant talent management issues, all 
groups identified developing employees 
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as a top issue and placed little impor- 
tance (<10%) on moving employees up 
through the organization or compensat- 
ing talent (see Figure 1). Although inter- 
nals and end users’ responses tended to 
trend in the same direction, the rankings 
of the remaining issues showed little 
consistency across the four rater groups. 
Academics tended to focus mainly on 
the middle stages of the employee life- 
cycle in terms of retention, develop- 
ment, and engagement. Externals stood 
out for their singular emphasis on selec- 
tion while also favoring development 
and performance management. Both 
internals and end users tended to focus 
on recruitment, retention, and develop- 
ment. 


Q2: Most Important Areas of 
HR Focus 


When asked about the two most impor- 
tant areas of HR focus, externals clearly 
identified selection and leadership devel- 


opment as their top two (see Figure 2). 
Although recruiting and performance 
management received the highest re- 
sponses for internals, nearly all areas 
captured between 3% and 13% of their 
responses. Top choices for academics 
were leadership development and em- 
ployee engagement. End users viewed 
succession/workforce planning, leader- 
ship development, and employee en- 
gagement as relatively more important 
areas. Similar to the prior question, the 
choices of internals and end users were 
more closely aligned relative to the 
other two rater groups. 


Q3: Biggest Challenges When Imple- 
menting Talent Management Systems 


When asked about the two biggest im- 
plementation challenges, senior leader- 
ship support was rated in the top two for 
internals, externals, and academics; in 
contrast, end users ranked it as their 
lowest priority (see Figure 3). End users 
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Figure 1. Two Most Important Talent Management Issues 


The Industrial Organizational Psychologist 


identified time far and away as their 
number one challenge (30%), while all 
other groups viewed this challenge as 
relatively less imposing (< 15%). Inter- 
nals and externals viewed cost as the 
biggest challenge while only 10% of end 
users had a similar perspective. Compet- 
ing strategic demands (17%) and dem- 
onstrating ROI (16%) were the tied for 
the second most selected challenge by 


Q4: Most Important Element of a Suc- 
cessful Talent Management System 


When asked to identify the two most 
important elements of a successful tal- 
ent management system (e.g., selection, 
360, performance appraisal, succession 
planning), all rater groups selected exe- 
cution as their first or second choice; 
this element was in the number one 
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Figure 2. Two Most Important Areas of HR Focus 
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Figure 3. Two Biggest Implementation Challenges 
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Figure 4). However, it is interesting to 
note that the internals and end users 
rated execution 9-12% higher than ex- 
ternals or academics. Another standout 
element for all rater groups except end 
users was business linkage. End users 
identified development as the second 
most important driver for success while 
the other three groups rated this ele- 
ment toward the bottom. Additional 
inconsistencies were noted in delivery 
and integration with current systems, 
with externals far below the other three 
groups (0% for delivery). Like previous 
questions, internals and end users ap- 
peared more closely aligned relative to 
the other two rater groups. 


Q5: Most Important Qualities in a Tal- 
ent Management System 


In terms of the most important qualities 
when selecting a talent management sys- 
tem, there was a lot of consistency across 
all four rater groups. Seven of the 15 quali- 
ties were rated by at least one group as 
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very important; of those seven only align- 
ment with company culture was consid- 
ered very important by all four groups. In 
addition to alignment with company cul- 
ture, end users rated simplicity, efficiency, 
and potential impact on organizational 
performance as very important. None of 
the rater groups shared end users’ views 
on simplicity; however, both end users 
and internals agreed that efficiency was 
very important. Only internals and aca- 
demics considered /egal defensibility to be 
very important, while all groups except 
internals viewed job relatedness as very 
important. 


Q6: Important Sources of Information 


When asked about the most important 
sources of information on new HR talent 
management initiatives, platforms, or 
tools, all groups except the end users 
identified professional peers outside 
your company in their top 2, whereas all 
groups except academics selected pro- 
fessional peers within your company as 
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Figure 4. Most Important Element of a Successful Talent Management System 
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a top 2. Also in the academics’ top 2 was 
professional/scientific conferences, 
whereas end users selected senior op- 
erational managers to complete their 
top 2. For the bottom 2, all groups se- 
lected blogs/chat rooms/social media, 
and all groups but externals included 
popular press/media. Instead, externals 
selected academic partners to complete 
their bottom 2. 


Discussion 


The current study examined the degree 
to which stakeholders along the HR sup- 
ply chain view talent management sys- 
tems, challenges, decisions, and so forth 
from a common perspective. The clear, 
overarching finding from this study is 
that the four groups in the HR supply 
chain are often focused on different is- 
sues and challenges. Like the tale of the 
blind men touching different parts of an 
elephant only later to learn they are in 
complete disagreement about what they 
touched, our study shows that these 
four groups have different and at times 
conflicting priorities. These differences 
may be caused by a lack of access and 
communication, or perhaps incompati- 
ble incentives. Future research toward 
understanding the root causes of these 
differences would be beneficial. 


What impacts the success of the supply 
chain is the degree to which each par- 
ticipant is meeting his/her own goals 


while also ensuring a successful out- 
come for the entire group. In an ideal 
world, a continuous feedback loop be- 
tween HR constituents would serve to 
inform the research, design, modifica- 
tion, and implementation of talent man- 
agement systems. For example, end us- 
ers might complain to their internal 
practitioners (HR business partners) that 
their company’s performance manage- 
ment system is cumbersome and inef- 
fective. The company would then pro- 
vide a forum for end users, internal 
practitioners, and external consultants 
or academics to discuss, research, evalu- 
ate, and identify performance manage- 
ment solutions that better meet the end 
users’ needs. Through these interac- 
tions, external consultants and academ- 
ics would become more attentive to the 
challenges that internal practitioners 
and their customers (end users) face, 
which will in turn inform new lines of 
research and inquiry. 


To reach this level of success, at least 
three things must happen. First, partici- 
pants in the supply chain must be incen- 
tivized to recognize and deliver based on 
the other stakeholders’ needs and con- 
straints. For example, research partner- 
ships could serve as mutually beneficial 
platforms for HR stakeholders: Academ- 
ics and external consultants could col- 
lect research, feedback, and input that 
would inform product and service design 
in exchange for providing participating 
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companies with access to lower cost, 
tailored applications. Internal practitio- 
ners and end users would have a voice 
in system design, and academics and 
external consultants would be able to 
leverage the input for future publication 
(academics) and business development 
(external consultants). 


Relatedly, internal practitioners and 
their companies must be more willing to 
provide greater access to the end user. 
As “gate keepers,” internal practitioners 
frequently must translate their custom- 
ers’ needs for external consultants. In 
light of this study, internal practitioners 
may not always understand or appreci- 
ate end users’ needs, priorities, and con- 
cerns. Opening the dialogue on end user 
needs and challenges—perhaps using a 
venue like the research partnerships 
discussed previously or brief surveys to 
collect perspectives and ideas on how to 
improve company systems—will in- 
crease understanding of one another’s 
incentives, constraints, and so on, as 
well as provide fresh perspectives on 
valuable and pragmatic solutions. 


Finally, |-O psychologists and other HR 
professionals are (correctly) raised on the 
dogma that job experts must be included 
in the development of talent manage- 
ment processes: SMEs ensure the job 
relatedness of the content. There is con- 
siderably less emphasis in our training on 
obtaining SME input on system function- 
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ality: we, as process experts, may believe 
SME input to be less valuable at this point 
in the talent management cycle. I-O and 
other HR programs must train their stu- 
dents to examine talent management 
systems (such as selection, 360, perform- 
ance appraisal, succession planning) 
more holistically and from the viewpoints 
of the various stakeholders. For example, 
graduate programs could present stu- 
dents with current, real-time issues fac- 
ing HR, requiring them to evaluate and 
diagnose root causes, interdependencies, 
requirements, and so on as well as ex- 
plore solutions from each perspective 
along the supply chain. Such systemic 
thinking will help to drive greater integra- 
tion and collaboration. 


Limitations 


Our study was primarily limited by our 
sampling. For example, our end users 
were sampled from only two companies, 
and therefore, we cannot comfortably 
extrapolate to other organizations. In 
addition, our external consultants came 
primarily from SIOP, which tends to be 
weighted toward “I”-side systems like 
selection (vs. “O”-side initiatives like 
change management). Future research 
efforts will focus on sampling end users 
from a broader range of companies as 
well as on tapping into other groups 
where organizational psychologists are 
better represented. 


Conclusions 


Although the discussion above provides 
a logical way to bridge the gaps, the mo- 
tivating factors—the drivers of behav- 
ior—among the four groups can make 
the bridge difficult to build. These fac- 
tors must be examined more closely to 
understand the change mechanisms re- 
quired to bridge the gaps. For example, 
external consultants are motivated to 
deliver standardized, efficient, and prof- 
itable solutions. Internal practitioners 
and end users look for customized solu- 
tions that meet their very specific needs. 
Academics’ studies are theory driven 
and may not lead to practical solutions 
that meet the needs of external consult- 
ants, internal practitioners, or end users. 
This misalignment of motives is not 
likely to ever be overcome completely, 
but recognition of the motives and find- 
ing ways to use them productively in 
bridging gaps is essential to building an 
efficient and effective supply chain that 
meets the needs of all stakeholders. 
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Introduction 


According to the 2010 U.S. Census, there 
are more than 56 million people in the 
United States with a disability (Brault, 
2010). That equates to one in every five 
U.S. citizens who could be positively add- 
ing value to the US job market. Initiatives 
are growing fast to encourage more dis- 
abled talent into the job market and to 
make the recruitment and assessment 
process barrier-free. In the U.S., the Cam- 
paign for Disability Employment (http:// 
www.dol.gov/odep/topics/ 
CampaignForDisabilityEmployment.htm) 
emboldens employers to understand 
how much value and talent people with 
disabilities add to America's economy. 
Despite this, very little research has been 
published on the selection and develop- 
ment of disabled talent. Moreover, from 
an industrial-organizational (I-O) psychol- 
ogy perspective, practitioners are faced 
with many open and unanswered ques- 
tions. This paper discusses the potential 
reasons of why research in this area has 
not been conducted and why there con- 
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tinues to be uncertainly around providing 
reasonable accommodations in psycho- 
metric testing for candidates with dis- 
abilities. 


In order to address this dilemma we pro- 
pose and initiate discussion on the fol- 
lowing questions: 


What do we mean by disabled talent? 
Disabled talent is used to describe a per- 
son recognized as having a disability un- 
der the Americans with Disabilities Act 
(ADA) 1990 and who is seeking to enter 
work or is already in employment. Un- 
der the ADA, “disability” refers to an 
individual who has a physical or mental 
impairment that substantially limits one 
or more major life activities. Major life 
activities may include, but are not lim- 
ited to, caring for oneself, performing 
manual tasks, seeing, hearing, walking, 
bodily functions, and so forth. Under the 
ADA, there does not exist a defined list 
of disabilities. However, common types 
may include mental health disorders, 
intellectual and learning disabilities, 


hearing impairment, visual impairment, 
mobility impairment, facial disfigure- 
ment, HIV, and cancer. Outside of the 
U.S. there are country-specific legisla- 
tions that promote who is considered 
as having a disability and what their 
entitlements are, for example, The UK 
Equality Act (2010) and Behin- 
dertengleichstellungsgesetz—BGG 
(German Equal Opportunities for Dis- 
abled People Act (2002). Each act has 
its own definitions and terms but 
broadly speaking cover a similar level of 
requirement for a person to be deemed 
disabled. 


Why is it important to encourage and 
facilitate recruitment of disabled talent? 
Acts and legislation covering the equal 
opportunities of disabled talent, all state 
that employers have a duty to provide 
reasonable accommodations in order to 
facilitate optimal performance in their 
employees with disabilities. By reason- 
able accommodations we refer to any 
modification made to an individual’s 
environment or situation that allows 
them to demonstrate their optimum 
performance. Within talent manage- 
ment, companies providing psychomet- 
ric assessments have a legal duty to sup- 
port their clients in providing appropri- 
ate accommodations to disabled candi- 
dates completing their assessments. 
Aside from legal duties, the US Cam- 
paign for Disability Employment high- 
lights that companies that are inclusive 


of people with disabilities significantly 
benefit from an increased pool of talent, 
higher levels of competencies, and more 
creative business solutions. Further- 
more, in the report How Fair Is Britain? 
(Equality and Human Rights Commis- 
sion, 2010) only 50% of disabled adults 
were in employment compared to 79% 
of nondisabled adults. With one in five 
adults in the UK classified as disabled, 
there is a potential of 5,000,000 cur- 
rently unemployed individuals who 
would add significant value to the UK 
employment market. With demand ever 
increasing to recruit and retain talent, 
embracing the potential of disabled tal- 
ent and providing barrier-free recruit- 
ment processes and assessments will be 
key. 


What is the role of l-O psychologists 
and talent management companies in 
assessing disabled talent? 

Talent management companies provid- 
ing psychometric assessments to candi- 
dates continue to see an increase in re- 
quests for reasonable accommodations. 
Applied to selection and development, 
reasonable accommodations refer to 
any changes that can be made to the 
assessments or recruitment process that 
remove barriers for access. Examples of 
reasonable accommodations within tal- 
ent management may include providing 
an alternative assessment format or 
adapting an assessment process to meet 
the needs of the candidate. There are no 
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definitive descriptions of what consti- 
tutes a reasonable accommodation; how- 
ever, the key term is “reasonable,” so 
any accommodation should be effective, 
practical, financially reasonable for the 
organization, and based on need not 
preference. With this in mind, I-O psy- 
chologists and talent management com- 
panies should be in a position to guide 
their clients on how to meet the specific 
needs of each disabled candidate in rela- 
tion to the services they offer. However, 
anxiety or lack of knowledge of the rele- 
vant legislation and disabilities may all 
feed into feelings of uncertainty when 
supporting clients with recruiting and 
developing disabled talent. This is de- 
spite national drives to encourage dis- 
abled talent to apply for positions and 
promotion (i.e., Campaign for Disability 
Employment, U.S.). Moreover, there has 
been very little research on the impact 
of disabilities on psychometric testing 
within I-O settings and the validity of the 
reasonable accommodations currently 
being offered. At present, talent man- 
agement companies provide their clients 
with best practice recommendations 
and aim to facilitate reasonable accom- 
modations where possible. However, 
when challenged on the validity of these 
accommodations and the scientific basis 
of the recommendations, there is little 
to fall back on. 
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What do we know about disabled tal- 
ent and their experiences of psychomet- 
ric assessments? 

The simple answer to this is “not very 
much.” Disabled applicant reactions to 
online psychometric assessments are 
not routinely collected, and there does 
not appear to be any research published 
in this area despite anecdotal evidence 
that complaints from candidates are in- 
creasing. Therefore, one area of re- 
search to focus on is applicant reactions. 
Because the people who know most 
about disabilities and the impact on tak- 
ing tests are the disabled talent group, it 
seems pertinent to use their expertise to 
help us understand the issues they face. 
This research could then contribute to 
future assessment development, as well 
as clarifying what reasonable accommo- 
dations are frequently required and may 
not be currently available. Pitoniak and 
Royer (2001) propose that there are a 
number of reasons why research into 
reasonable accommodations may be 
difficult. Issues faced may include small 
sample sizes, variability in participants’ 
disabilities and needs, and inconsistency 
in provided accommodations. All these 
hurdles would need to be overcome for 
successful research to be completed. 


What can be currently offered in terms 
of reasonable accommodations and 
psychometric assessments? 

It is beyond the scope of this article to 
document all possible psychometric test 


accommodations. We have already 
discussed how there is not an absolute 
definition of the term “reasonable ac- 
commodation”; however, we can dif- 
ferentiate test type by mode of ad- 
ministration (online tests, offline tests, 
and paper-and-pencil tests). Each test 
type will be impacted differently, de- 
pending on the nature and severity of 
the disability. With online assess- 
ments, using a screen reader, adaptive 
keyboards, increasing resolution or 
font size, or other assistive technology 
should be possible. People with visual, 
hearing, motor impairments, or a spe- 
cific learning difficulty all may utilize 
such technology. However in practice, 
many online assessment formats cur- 
rently make it impossible to use this 
technology. Offline but computer- 
based tests may run into similar prob- 
lems as online testing in terms of as- 
sistive technology, but some tests may 
be adapted into a standard document 
format (i.e. Microsoft Word or Excel) 
in order to make assistive technology 
compatible. Tests, however, that in- 
volve images or complex graphs and 
tables may still not be accessible in 
this way. Paper-and-pencil tests can 
usually be adapted in presentation, 
with changes such as paper color, font 
size, and contrast changes being im- 
plemented. These adaptations may 
make the tests valid for some people 
with disabilities; however, there will 


always be others for whom the test 
remains inaccessible. 


An additional element of many apti- 
tude, cognitive ability, and skills tests is 
the requirement that tasks are com- 
pleted in a set time limit or that the 
test is speeded. Whether other accom- 
modations are made or not, providing 
additional time is often cited as being a 
favored approach and is often seen as 
the only reasonable accommodation 
possible. There are, however, a number 
of issues with taking this stance. First, 
although extra time is often cited as 
part of best practice within educational 
settings, there is little empirical evi- 
dence to inform I-O psychologists on 
how to apply this. Second, the quanti- 
tative question remains of how much 
time should be given? Third, how do 
we then compare candidates who have 
been given extra time to those who 
have not? Fourth, the message that 
extra time is always an appropriate 
reasonable accommodation is likely not 
to be a valid assumption, as all accom- 
modations should be based on individ- 
ual need. Finally, how do we deal with 
tests that are speeded and therefore 
cannot have their timing altered? 


To date we could find no evidence or 
research on the effect of extra time on 
test performance outside of educa- 
tional settings. Sireci, Scarpati, and Li 
(2005) reviewed the literature on pro- 
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viding reasonable accommodations in 
school- and university-based exams. Al- 
though they concluded that there is con- 
tradictory evidence of the validity of rea- 
sonable accommodations due to the 
array of accommodations reported and 
the heterogeneity of the students in the 
samples used, they found that extending 
exam time generally improved the per- 
formance of all students, irrespective of 
whether they had disabilities or not. 
However, students with disabilities 
tended to exhibit relatively greater in- 
crease in scores with additional time 
over their nondisabled peers. Similar 
research within occupational settings 
has not been conducted, yet it is possi- 
ble that candidates requesting extra 
time may rely on these past experiences 
(from school and college) to inform em- 
ployers of how much extra time they 
need. Although we are not disputing this 
method of establishing the reasonable 
accommodation, we are questioning the 
reliability and validity of extra time 
within an occupational testing environ- 
ment as we do not have any empirical 
evidence to support this assumption. 
Pitoniak and Royer (2001) also provide a 
comprehensive review of the social, le- 
gal, and psychometric issues around 
testing accommodations within educa- 
tion settings. 


One theory that has been highlighted in 
educational testing and could be trans- 
ferred to an I-O setting is the interaction 
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hypothesis. This theory has been pro- 
posed to justify the use of reasonable 
test accommodations (Koenig & Bach- 
man, 2004; Malouf, 2001, cited in 
Koenig, 2002; Weston, 2002). The the- 
ory argues that when test accommoda- 
tions are given to people with disabili- 
ties their test scores will improve; how- 
ever, improvement will be relative to 
the scores they would have obtained 
had they taken the test under standard 
conditions. Second, the accommodation 
will not significantly improve students 
without disabilities’ scores (although it 
may be expected that some accommo- 
dations such as extra time will shift all 
scores across the distribution). The 
name of the theory interaction hypothe- 
sis relates to the interaction between 
candidate group (disabled or nondis- 
abled) and test administration condition 
(accommodated or standardized). This 
model could be applied to I-O assess- 
ments in order to establish whether an 
accommodation is reasonable and valid, 
remembering that all accommodations 
made do not necessarily need to be op- 
timal or based on candidate preference, 
but they must be reasonable for each 
individual. 


How do we interpret and compare dis- 
abled and nondisabled candidate scores? 
A premise of the definition of reason- 
able accommodations is that that it al- 
lows individuals to perform to the best 
of their ability in order to be compared 


to their nondisabled peers. Phillips 
(1994) outlines five considerations that 
should be adhered to when deciding 
whether an accommodation is reason- 
able and valid. If any one of these ques- 
tions is answered “yes,” there is reason- 
able doubt that applying the accommo- 
dation would allow the scores obtained 
from disabled candidates to be com- 
pared to their nondisabled peers: 


e Will format changes or alterations 
in testing conditions change the 
skill being measured? 

e Will the scores of examinees 
tested under standard conditions 
have a different meaning than 
scores for examinees tested with 
the requested accommodation? 

e Would examinees without disabili- 
ties benefit if allowed the same 
accommodation? 

e Does the disabled examinee have 
any capability for adapting to stan- 
dard test administration condi- 
tions? 

e Does the disability evidence or 
testing accommodation policy 
based on procedures with doubt- 
ful validity and reliability? 


In order to consider the practicality of 
using these questions we refer to an 
example. A visually impaired candidate 
is asked to complete a test of verbal rea- 
soning. The candidate requires the test 
to be transformed from an online as- 
sessment to a standard word processing 


document that can be read by their 
computerized screen reader. They also 
require additional time to complete the 
test as using the screen reader length- 
ens the administration process. Answer- 
ing Phillips’ (1994) five questions firstly, 
the test construct has not been altered 
and the skill (verbal reasoning) remains 
consistent. The American Educational 
Research Association, American Psycho- 
logical Association, and National Council 
on Measurement in Education (1999) 
suggest that evidenced professional 
judgment should be sufficient to support 
claims of score equivalence where ac- 
commodations are made that do not 
impact on the construct being assessed. 
Second, the meaning of the score should 
also not be impacted on by the accom- 
modation, that is, percentage of ques- 
tions correctly answered would still form 
the basis of the verbal reasoning score 
obtained. Third, it can be assumed that 
using a screen reader would not benefit 
candidates without disabilities. The allo- 
cation of additional time is perhaps 
more questionable; however, if a timing 
element is applied to a test in order to 
facilitate the administration process and 
does not feed into the candidate’s score, 
additional time for the visually impaired 
candidate should not benefit them over 
nondisabled candidates. Answer to 
Question 4 is no, the disabled candidate 
cannot access the test without the ac- 
commodation being made. Finally, for 
Question 5, there is no evidence that the 
procedures presented are invalid or un- 
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reliable; however, this is due to a lack of 
research and information in this area. 
We can therefore conclude that the sug- 
gested accommodations are reasonable 
and that the scores gained from the test 
should reflect the true verbal reasoning 
ability of the candidate. 


What we now have to consider is 
whether these scores can be compared 
to a standardized norm for the assess- 
ment completed. There are two possible 
scenarios, if the items were selected 
from the standardized test item pool 
and were of a similar difficulty to the 
standardized assessment, then it should 
be assumed that the candidate’s scores 
are a true reflection of ability on this 
particular test and can be compared to 
the standardized norm. If however, the 
items selected for the accommodated 
test version are shown to be a different 
difficulty level to the standardized as- 
sessment, the scores cannot be com- 
pared to the general norm. Accommo- 
dated tests where different items are 
used from the standardized test can 
never be directly compared on the same 
norm. In this case, the percentile score 
for the candidate should be used to al- 
low the examiner to interpret where a 
candidate lies on a normal distribution 
for the accommodated test and inter- 
preted independently of candidates’ 
performances on other assessments, 
irrespective of whether the underlying 
construct is the same. Clearly, this is 
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complicated and likely to be difficult for 
employers to effectively implement. I-O 
psychologists can help by providing pro- 
fessional judgment in individual cases 
and more clear evidence-based practice 
guidelines. 


What evidence is there on performance 
of disabled candidates on psychometric 
assessments and later job related per- 
formance? 

Shockingly, we have no substantial evi- 
dence as a field regarding the perform- 
ance of one of the largest cross-cultural 
minority groups on our core toolkit of 
assessments of job-related individual 
differences. We know that disabled can- 
didates are more likely to stay in a job 
for longer compared to their nondis- 
abled peers (Office of Disability Employ- 
ment Policy), but we have no evidence 
of the predictive validity of assessments 
once accommodations are made. The 
educational literature provides some 
guidance, as it has been shown that end 
of high school exams and college en- 
trance exams did not predict college or 
graduate school performance (Braun, 
Ragosta, & Kaplan, 1988). Interestingly, 
this study concluded that college per- 
formance was significantly overpre- 
dicted for some students who received 
additional timing, especially in candi- 
dates with specific learning difficulties 
who achieved relatively good high 
school scores. The authors conclude ex- 
tra time provision needs to be better 


matched to type of disability and that 
this could be achieved through further 
research studies. Oppler, Mitchell, Muel- 
ler, Dunleavy, and Glenn-Dunleavy 
(2010) also recently presented research 
on extra time for disabled candidates 
and later performance, specifically look- 
ing at the Medical College Admission 
Test (MCAT) and medical school per- 
formance. Their results suggested that 
for some candidates who were given 
extra time on the MCAT, their subse- 
quent performance in medical school 
was significantly overpredicted. 


Is there really a fear factor around how 
to support disabled talent in selection 
and development practice? 

This is a difficult question to answer; 
within I-O psychology there clearly is a 
lack of research and literature on dis- 
abled talent. However, how much of this 
is due to uncertainty around legislation 
or anxiety around how to approach test- 
ing is unknown. It is also possible that 
there are professionals who have knowl- 
edge of best practice with disabled tal- 
ent but have not disseminated this. 
Within I-O psychology we need to pro- 
mote this area of research so that peo- 
ple can feel confident coming forward 
and presenting their ideas, theories, and 
experience to help us develop more evi- 
dence-based guidance. At present, tal- 
ent management companies may rely on 
few individuals to “fly the flag” and im- 
prove the service they offer to both cli- 


ents and candidates with disabilities. 
However, best practice recommenda- 
tions and guidance are often outdated 
and based on historical practices rather 
than actual empirical evidence. Thus 
despite good intentions, recommenda- 
tions may be invalid, make tests unreli- 
able, or the accommodations are simply 
inefficient or irrelevant for the test 
taker. Knowing this, l-O psychologists 
face a dilemma: Although they want to 
promote and be inclusive of disabled 
talent, they do not want to provide in- 
correct advice. In the age of increased 
lawsuits and legal challenges from candi- 
dates and clients in relation to reason- 
able accommodations and equal oppor- 
tunity policy, is it any wonder that avoid- 
ance of the topic occurs? 


To sum up, the purpose of this article 
was to raise awareness of the topic of 
assessing disabled talent for selection 
and development and to provoke I-O 
psychologists to consider why this area 
has received such little attention and 
research. Whereas other protected 
groups including ethnicity and gender 
have received plenty of research atten- 
tion, disabled talent has not. A main rea- 
son for this may be due to the infinite 
types and subtypes of disability. More- 
over, this difficulty in heterogeneity may 
be why there has been little research on 
disability subgroups and reasonable ac- 
commodations as individual differences 
in nature, severity, and impact of disabil- 
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ity means group comparisons are very 
difficult to interpret. 


We did not aim to provide answers to 
the questions posed but spark further 
discussion. In the forthcoming years, we 
hope that the profession will be able to 
provide some of the answers to these 
questions as we embark on exciting re- 
search in a number of areas including 
validity and reliability of accommodated 
assessments, applicant reactions to psy- 
chometric assessments, and analysis of 
the frequency and nature of accommo- 
dations requested. By assessing these 
areas, we hope to be able to provide the 
basis of truly scientifically supported 
best practice recommendations for can- 
didates, recruitment and human re- 
source professionals, and l-O psycholo- 
gists and others working in talent meas- 
urement. 


1 It should be noted that the definition of Disability that 
the census uses for their purpose is different from the 
legal term used by the ADAAA. 
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Reflections on the State of I-O Research and Practice: 
Lessons Learned From Performance Management 


Alan L. Colquitt 
Eli Lilly and Company 


Background and Context 


After 28 years working in organizations, 
my performance has been evaluated, 
I’ve evaluated the performance of oth- 
ers, and I’ve been a part of numerous 
efforts to design performance evalua- 
tion systems. However, until recently, | 
never had formal responsibility for these 
systems. 


At the time, | knew employees didn’t 
like these systems. | didn’t like these 
systems. | also assumed, like many oth- 
ers, you could never please everyone 
with performance management (PM), 
that all systems had their “warts,” you 
simply picked which “warts” you pre- 
ferred. In fact, if you were like most or- 
ganizations, you routinely changed your 
system so you could experience differ- 
ent “warts” every few years. | also never 
thought too deeply about the design of 
these systems. From graduate school | 
knew there was academic research re- 
lated to PM. I vaguely associated this 
research with cognitive process models 
and | couldn’t see how this could be 
relevant to real PM systems in organiza- 
tions. 
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Shortly after assuming responsibility for 
PM, my company chartered a project to 
review our process. | decided to look 
into what the science had to say about 
designing these systems. After nearly 2 
years, | learned a lot about PM, but | 
also observed some things about our 
field. My observations center on a few 
general questions: 


- What information is guiding practice 
in organizations? 

- What is the role of research in in- 
forming practice in organizations? 

- Where is the research coming from? 

- Where are business leaders and HR 
professionals turning for advice and 
information? 


Some of my observations have been 
noted by others (see Aguinis & Pierce, 
2008, for example). Although some of 
my points are minor irritations, others 
really concern me about the future of 
our field and our ability to improve prac- 
tices and outcomes in organizations. | 
will frame my comments in terms of PM- 
related research and practices, but I’m 
confident these issues generalize to 
other topical areas as well. 


We Don’t Pay Much Attention to 
Academic Research 

There is good theory and academic re- 
search out there. It surprised me that 
practices in organizations bear little re- 
semblance to what would be recom- 
mended by academic theory and re- 
search. Practitioners, HR professionals, 
and business leaders may not be aware 
of this research or they may be paying 
attention to other sources of informa- 
tion. | suspect it is some of both. Others 
have written about this problem very 
articulately (see Pfeffer and Sutton, 
2006, about the field of management 
and Briner and Rousseau, 2011, related 
to our own field). 


| found a lot of research that was useful 
in guiding me in redesigning PM systems. 
The implications of much of this research 
were very clear. | also found that many 
practitioners don’t like them because 
they contradict current practice. Consider 
these examples. 


Nearly all PM systems in organizations 
have some focus on feedback and coach- 
ing. Kluger and DeNisi (1996) conducted a 
meta analysis of the effects of feedback 
interventions on performance. In a third of 
the studies, feedback actually hurt per- 
formance. They discovered when feedback 
doesn’t focus on the task (i.e., it focuses on 
the person or “meta-task” processes), per- 
formance suffers. This is very helpful for 
designers of PM systems and training. Su- 


pervisors should focus on the work and on 
how to help employees do the work bet- 
ter, not on how employees should be 
when they are doing the work or—worse 
yet—how they should be period. This also 
provides important context to neurosci- 
ence research reporting that threat cen- 
ters in the brain are activated when people 
receive feedback (Rock, 2009). 


A second study by Brown, Sturman, and 
Simmering (2003) focused on compensa- 
tion policy and organizational perform- 
ance among hospitals. When it comes to 
pay and pay differentiation, the assump- 
tion is “more is better.” Economic theo- 
ries and principles (e.g. agency theory, 
tournament theory) rule the day in this 
area. These theories hold that people 
are motivated primarily by financial re- 
wards, and more differentiation pro- 
vides more motivation. Those who get 
big rewards are motivated to keep 
them; those who get nothing are moti- 
vated to get them. This study provides 
reasonable doubt on this assertion. 
There was no main effect for dispersion 
on hospital effectiveness. High disper- 
sion was only associated with higher 
performance for lower pay levels. Bloom 
(1999) also found similar results with 
individual and team performance in 
baseball. This is helpful. Maybe we 
should reduce the differentiation in our 
reward systems, especially in companies 
and industries with relatively high pay- 
ing positions. 
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Finally, almost all PM systems involve 
ratings and most also link rewards (base 
pay increases, bonuses) to these ratings. 
There can be a lot of money riding on 
these ratings. O’Neil, Carswell, and 
McLarnon (2012) summarized the re- 
search on the quality, accuracy, and va- 
lidity of performance ratings, concluding 
they have substantial rater and small 
ratee components. The percentage of 
ratee variation ranged from a low of 8% 
to a high of 32% across the studies they 
reviewed. Performance ratings have far 
more to do with the person doing the 
rating than the person being rated. 
Worst case, it feels like a lottery; em- 
ployees pull a ping-pong ball out of a 
machine that reveals their rating. This is 
very helpful—frightening, but helpful. 
Maybe we should abandon formal su- 
pervisor performance ratings in favor of 
other approaches to accomplish our 
goals. At the very least, maybe we 
should make the ratings as coarse as 
possible (maybe two or three buckets) 
or deemphasize individual ratings as 
they affect rewards. This sentiment is 
captured well by Stallings and Gilmore 
(1972) in their discussion of Ali-Frazier 
heavyweight title fight in 1971. At the 
time, this fight had the largest purse for 
a sports contest in history. Across 15 
rounds, the three judges scored it 8-6-1, 
9-6 and 11-4 for Frazier. Although the 
decision was unanimous, all three 
agreed on only seven rounds. This is a 
simple task and even experts don’t 
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agree. Evaluating the job performance 
of another human being is far more 
complex and millions of amateur super- 
visors do it every year. After their analy- 
sis, the authors concluded: “Our esti- 
mated reliabilities and validity would 
appear to be too low where so much 
money and prestige is at stake.” | could- 
n’t agree more. 


What Passes for “Research” Is Changing 
Several things concern me here. First, it 
has become very popular for consulting 
firms and HR think tanks to survey com- 
pany representatives (executives, HR 
professionals, or other representatives) 
and ask what their companies do and 
what they think is important. As a result, 
we know a lot about what companies 
are doing and what company represen- 
tatives think are important in many dif- 
ferent topical areas. However, we 
should not confuse what organizations 
do with what organizations do that actu- 
ally works. Much of what informs organ- 
izational practices is the former not the 
latter. 


External benchmarking has also become 
big business. Benchmarking tells us what 
companies are doing in a particular area 
or who is doing something different. 
Should a company do something simply 
because another company is doing it? 
Should a company do something simply 
because Google or GE (or another suc- 
cessful company) does it? We need to 


know more. How are they defining 
“success;” why is a particular company 
being profiled? Is their success related 
to their practices in this area? Will this 
practice work in my company? These 
benchmarking reports and case studies 
are very widely circulated. They get the 
attention of company leaders and HR 
professionals and have been instrumen- 
tal in changing practices in organiza- 
tions. 


In evidence-based management lan- 
guage, the standard for “evidence” 
seems to be getting weaker. If lots of 
companies do it, it must be right. If a 
“good” company does something, it 
must be right. Make no mistake; | like to 
know what others are doing. This infor- 
mation is extremely helpful. However, | 
also want to know what practices actu- 
ally work to make individuals and or- 
ganizations more effective. 


Consulting Firms and HR Think Tanks 
Are Playing Strong Roles in 
Influencing Practice in Organizations 
Upwards of 85% of the Fortune 500 
companies are members of the Corpo- 
rate Executive Board. The Conference 
Board has over 1,200 public and private 
companies as members. The Institute 
for Corporate Productivity (2012) has 
had record growth in its membership 
roster—the majority of which are For- 
tune 500 companies. These firms are 
growing (McGraw, 2012), and HR staffs 


are shrinking as their work gets out- 
sourced. HR staffs are increasingly de- 
pendent upon these organizations for 
information on what’s going on in or- 
ganizations and what they should be 
doing. These firms also have tremen- 
dous “share of voice” when it comes to 
capturing the attention of HR practitio- 
ners and business leaders. These organi- 
zations rely heavily on their own re- 
search, their own experiences, and the 
experiences of their clients/members in 
advising companies on what they should 
do. They tend not to rely as much on 
rigorous academic research to justify 
their recommendations. 


We Ignore Work From Other Disciplines 
Studying the Same Problems 

In the area of PM, several disciplines are 
in on the action: psychology, economics 
(especially behavioral economics), man- 
agement, sociology, political science, 
medicine, education, and public policy. 
Even within psychology, there is re- 
search relevant to PM being done by I-O 
psychologists, social psychologists, cog- 
nitive psychologists, and clinical psy- 
chologists. Academic research related to 
PM appears in dozens of different jour- 
nals. Very few researchers look beyond 
their own academic discipline when for- 
mulating their theories and conceptual- 
izing their research. Gilbert (2002) 
makes this point in his critique of col- 
laboration among social psychologists 
and cognitive neuroscientists. 
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Few Are Examining and Challenging the 
Assumptions and Beliefs That Underlie 
Current Practice in Organizations 

In organizations, we typically engage in 
single-loop learning. We try something 
and if it doesn’t work we try something 
different. We need more double-loop 
learning. We need to step back and ex- 
amine (and challenge) the assumptions, 
beliefs, and values that underlie what 
we do. “Does money really motivate?” 
“Can we really measure performance 
well enough to tie big rewards to it?” In 
the PM area, practices appear to be 
guided by outdated models and models 
borrowed from other disciplines. They 
don’t always hold up. For some notable 
exceptions, see Manzoni (2008) and 
Gneezy, Meier, and Rey-Biel (2011). In 
some cases the deeper thinking and in- 
quiry is actually coming from outside our 
field by writers like Dan Pink (Pink, 
2009). He uses psychological and eco- 
nomic research to challenge conven- 
tional assumptions and beliefs about 
what motivates individuals. His argu- 
ments are easy to understand and com- 
pelling, and business leaders and HR 
practitioners are paying attention. 


It’s not surprising organizations don’t 
look more deeply at these problems. 
We’re not splicing genes. Business lead- 
ers and HR professionals think they 
know what to do based on their own 
personal experiences. Institutionaliza- 


organizations. Practices get embedded 
and it is hard to get them changed in any 
fundamental way. 


Reading the Academic Literature Can 
Be a Frustrating Experience 

This is probably the “nature of the 
beast” in academic research. First, re- 
search reviews make general statements 
that | don’t think accurately reflect the 
current state of the research. Their re- 
views imply that research evidence ina 
particular area is stronger than it should 
be. For example, below are two quotes 
from two different articles about empiri- 
cal support for pay for performance: 


While there are concerns about the 
wisdom of pay-for-performance, par- 
ticularly for individual performance, 
research reviews find ample evidence 
that pay-for-performance is associated 
with higher performance at both the 
individual and organizational level of 
analysis (Sturman, Trevor, Boudreau, 
& Gerhart, 2003). 


prior research has convincingly shown 
that pay-for-performance can have 
substantial positive effects on per- 
formance (Gerhart, Rynes, & Fulmer, 
2009). 


Having read much of this literature, | think 
“ample evidence” and “convincingly” 
overstate the case. In this particular area, 


tion and inertia also work against usin the research support is mixed at best. 
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These systems are more effective for im- 
proving quantitative output, for simple 
tasks and jobs, where performance can be 
measured well. This doesn’t cover a lot of 
jobs in my company. These systems can 
also have nasty side effects. This point is 
important because organizations seem to 
believe evidence to support this practice is 
“convincing”. Over 90% of organizations 
say they tie individual rewards to individ- 
ual performance in some way (i4cp, 2012). 


Researchers also selectively report re- 
sults in narrative reviews. Many pay-for- 
performance articles cite studies by 
Paasch and Shearer (1999) and Jenkins, 
Gupta, Mitra, and Shaw (1998) to sup- 
port the productivity-improving effects 
of pay-for-performance. Most fail to 
mention that although these studies 
show a positive effect for incentives on 
performance quantity, this is not the 
case for performance quality. Again, this 
is an important point. It is very difficult 
to come up with quantitative perform- 
ance measures for most jobs. 


So What Do We Do? 


Everyone has “skin” in this game. If you 
work in an organization or consult with 
organizations: 


- Read the academic research and use 
it to guide your recommendations. 
No excuses. 


- Look at meta-analyses if they are 
available. These studies can give you 
exactly the evidence you need and 
can tell you the conditions under 
which practices work. 

- Where meta-analyses are not avail- 
able, read the original academic re- 
search. Don’t depend on others’ re- 
views of it. Come to your own con- 
clusions. 

- Cast a wide net. Look across disci- 
plines. 

- Use consultants wisely. Ask them 
about published academic research 
to support their recommendations. 

- Look at benchmark results critically 
and choose benchmark companies 
wisely. Companies vary in the rigor 
they use to decide on the practices 
they adopt. 

- Start asking “Why?” Challenge as- 
sumptions, beliefs, and paradigms 
that underlie practices. Make this a 
routine part of your projects. Help 
your HR partners and business lead- 
ers understand organizational prac- 
tices at a deeper level. 


If you make a living doing research in 
academic or other institutions: 


- Conduct good primary research stud- 
ies and replicate good studies done 
by others. 

- Look at research from other disci- 
plines; do more cross-discipline re- 
search. 
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- Conduct more meta-analyses. 

- Do more theoretical work on para- 
digms, models, and frameworks to 
guide research and practice. Look 
across disciplines. 

- Find better ways to get your re- 
search into the hands of HR practi- 
tioners and business leaders. 

- Find more compelling ways to write 
about and market your research. 
Take a page from writers like Pink 
(2009). 


It has been said many times, but we also 
need more academic—practitioner part- 
nerships. Practitioners need to work 
with academics to review their research 
for implications. We need to partner on 
new forums or media to showcase the 
implications of academic research. 
Where these forums exist, we need to 
support them. We need to commit to an 
evidence-based management mindset. If 
practitioners, HR professionals, and 
business leaders ask their consulting 
partners and HR think tanks what the 
published research says, these firms 
may begin to supplement their experi- 
ence with more academic research evi- 
dence. Finally, we need to find creative 
ways to get the results of academic re- 
search in front of HR professionals and 
business leaders. If we do some of these 
things we have a better chance of mean- 
ingfully improving practices, individuals, 
and organizations. 


The Industrial Organizational Psychologist 


References: 


Aguinis, H., & Pierce, C. A. (2008). Enhancing 
the relevance of organizational behavior 
by embracing performance management 
research. Journal of Organizational Behav- 
jor, 29, 139-145. 

Bloom, M. (1999). The performance effects 
of pay dispersion on individuals and or- 
ganizations. Academy of Management 
Journal, 42(1), 25-40. 

Briner, R. B., & Rousseau, D. M. (2011). Evi- 
dence-based I-O psychology: Not there 
yet. Industrial and Organizational Psychol- 
ogy, 4, 3-22. 

Brown M. P., Sturman M. C., & Simmering, 
M. J. (2003). Compensation policy and 
organizational performance: The effi- 
ciency, operational, and financial implica- 
tions of pay levels and pay structure. 
Academy of Management Journal, 46(6), 
752-762. 

Kluger A. N., & DeNisi A. (1996). The effects 
of feedback interventions on perform- 
ance: A historical review, a meta-analysis, 
and a preliminary feedback intervention 
model. Psychological Bulletin, 119, 254- 
294. 

Gerhart, B., Rynes, S. L., & Fulmer, |. S. 
(2009). Pay and performance: Individuals, 
groups, and executives. The Academy of 
Management Annals, 3:1, 251-315. 

Gilbert, D. (2002). Are psychology’s tribes 
ready to form a nation? Trends in Cogni- 
tive Sciences, 6, 3. 

Gneezy U., Meier S., & Rey-Biel P. (2011). 
When and why incentives (don’t) work to 
modify behavior. Journal of Economic Per- 
spectives, 25(4), pp 1-21. 


Institute for Corporate Productivity. (2012). 
Tying pay to performance. Member re- 
search report. Seattle, WA: Author. 

Jenkins, G. D., Gupta, N., Mitra, A. & Shaw, J. 
(1998). Are financial incentives related to 
performance? A meta-analytic review of 
empirical research. Journal of Applied Psy- 
chology, 93, 777-787. 

Manzoni J. F. (2008). On the folly of hoping 
for A simply because you are trying to pay 
for A. In M.J. Epstein, & J.F. Manzoni 
(eds.), Performance measurement and 
management control: Measuring and re- 
warding performance. Greenwich CT: JAI 
Press. 

McGraw M. (2012). Running lean. http:// 
www.hreonline.com/HRE/print.jhtml? 
id=533343295 

O’Neill, T. A., Carswell, J. J., & McLarnon, M. 
J. W. (2012) Performance ratings have 
larger rater and small rate components, 
usually. Paper presented at the annual 
meeting of the Society for Industrial and 
Organizational Psychology, San Diego, CA. 


International Economic Review, 41(1), 59- 
92. 

Pfeffer, J., & Sutton, R. I. (2006). Hard facts, 
dangerous half-truths & total nonsense: 
Profiting from evidence-based manage- 
ment. Cambridge, MA: Harvard Business 
Press. 

Pink, D. (2009). Drive: The surprising truth 
about what motivates us. New York: Pen- 
guin 

Rock, D. (2009). Your brain at work: Strate- 
gies for overcoming distraction, regaining 
focus, and working smarter all day long. 
New York, NY: HarperCollins. 

Stallings W. M., & Gillmore, G. M. (1972). 
Estimating the interjudge reliability of the 
Ali-Frazier fight. Journal of Applied Psy- 
chology, 56(5), 435-436. 

Sturman, M. C., Trevor, C. O., Boudreau, J. 
W., & Gerhart, B. A. (2003). Is it worth it to 
win the talent war? Evaluating the utility 
of performance-based pay. CAHRS Work- 
ing Paper Series. Paper 35. http:// 
digitalcommons.ilr.cornell.edu/ 


Paarsch H. J., & Shearer B. (2000). Piece cahrswp/35 
rates, fixed wages, and incentive effects. 
Statistical evidence from payroll records. 
Contents Features Editorials Reports my.SIOP 


October 2013 Volume 51 Issue 2 


It’s not always this obvious. 


ry A 


But it can be. 
There’s a science to picking talent. 


You know how important it is to have the right people in the 
right roles. So do we. More than 30 million people annually 
are assessed, selected or developed using our SHL Talent 
Measurement Solutions. With a unique combination of proven 
best practices and science-based talent analytics, we help 
executives improve business performance by realizing the 
value and potential of people. 


CEB SHL Talent 
See what you’ve been missing at SHLisCEB.com. — Measurement 


Values of I-O Psychology, Another Example: What and Whom We 
Don’t Study and What It All Suggests About the Profession 


Joel Lefkowitz 
Baruch College, and The Graduate Center, CUNY 


Full disclosure: This essay is tendentiously 
aimed at challenging anyone who still be- 
lieves that l-O psychology is entirely scien- 
tific—that is, that our research and prac- 
tice is entirely, or even primarily, objec- 
tive and “value-free.” It’s an important 
issue because that mistaken belief pro- 
vides the rationale for excluding and even 
denigrating the expression of societal and 
humanistic values in our work and work- 
places—while simultaneously giving ex- 
pression to an (often unacknowledged) 
alternative value system that privileges 
organizational economic and financial 
criteria and shareholder value virtually to 
the exclusion of anything else. It’s impor- 
tant also because the corporatist values 
contribute to a distorted view of who we 
are, what we do, and what we should be 
doing, as well as to misdiagnosing the 
consequent adverse manifestations, even 
when the symptoms are recognized. From 
time to time | have attempted to illustrate 
some of these manifestations—often by 
elaborating and/or reinterpreting the 
sage observations of others. After sum- 
marizing some of those examples, | pre- 
sent another recent illustration and then 
draw some conclusions. 


Some Indications of l-O Values 


Managerialist Bias 

This salient perspective (cf. Baritz, 1960; 
Katzell & Austin, 1992; Kornhauser, 
1947; Zickar & Gibby, 2007) is expressed 
by a focus on responding to organiza- 
tional needs and problems that deter- 
mines not only our professional practice 
but much about our scientific research 
as well. Even for topics that draw the 
attention of I-O psychologists, such as 
intelligence (cf. Scherbaum, Goldstein, 
Yusko, Ryan, & Hanges, 2012) , there is a 
tendency to emphasize only those as- 
pects that are directly responsive to or- 
ganizational goals and economic objec- 
tives—for example, selection testing 
(Lefkowitz, 2012b). Similarly, “worker 
well-being topics [a]re often studied 
only in relation to other constructs of 
interest to management” (Zickar & 
Gibby, 2007, p. 66). 


A reviewer suggested that the growth of 
“corporate social responsibility” (CSR) as 
an organizational concern deserves 
mention in this context (cf. Lefkowitz, 
2003, Chap. 11; 2007). Unfortunately, 
however, my reading of the CSR litera- 
ture reveals a paucity of 
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l-O psychologists among the progressive 
business leaders, social critics, and man- 
agement scholars who advance this per- 
spective. For example, the upcoming 
(2013) meeting of the Academy of Man- 
agement has scheduled about a dozen 
sessions whose topics include 
“legitimacy through stakeholder dia- 
logue,” “how to change paradigms in 
capitalism,” “capitalism in question,” 
“capitalism at the crossroads,” 
“capitalism in crisis,” and “questioning 
self-interest.” | believe that few, if any, 
such challenges to the system are posed 
at SIOP conferences. 


Minimal Focus on Individuals, 
Especially Employees 

We deemphasize the individualistic per- 
spective in our research (Weiss & Rupp, 
2011)—which then also precludes any 
possibility of “a normative- or morally- 
driven empathic and humanistic ap- 
proach to individual workers and their 
circumstances” (Lefkowitz, 2011b, p. 
113). Despite the inclusive ethical pre- 
scription “to improve the condition of 
individuals, organizations and society” 
(American Psychological Association, 
2002), in our practice we generally 
adopt a one-sided and antagonistic view 
of issues such as employee rights, em- 
ployment at will (cf. Dunford & Devine, 
1998), and union representation 
(Dawkins, 2012; Zickar, 2001). 
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Absence of a Normative Stance 
Banishing any whiff of societal values 
from I-O has meant failing to advance 
and advocate a normative (i.e., moral, 
and unavoidably subjective) view of 
what organizations ought to be like. For 
example, it has been observed that, al- 
though we produce a great deal of re- 
search on organizational fairness/justice, 
we don’t do much about it (Greenberg, 
2009). In large measure that is because 
in my opinion we largely confine our- 
selves to the phenomenal realm of per- 
ceived not actual (in)justice and the do- 
mains of procedural and interactional, 
not distributive, justice (Lefkowitz, 2008, 
2009; also, cf. Roback, 1917). But this 
misconstrues a system- (i.e., organiza- 
tion-) level attribute as an individual- 
level construct and enables us to avoid 
potentially challenging management’s 
distributional policies and practices. 
Why haven’t I-O psychologists who are 
interested in studying (and putatively 
remedying?) workplace injustice focused 
on the corporate suppression of labor 
rights and freedom of association 
(Compa, 2000; Dawkins, 2012; Gross, 
2002)? 


Leaders in the field have intermittently 
called attention to l-O psychology having 
an “identity crisis” (e.g., Ryan, 2003; 
Ryan & Ford, 2010). This has often been 
interpreted as essentially a marketing 
problem (e.g., “concerns about the visi- 
bility of the field, ...about how well we 


are differentiated from other like disci- 
plines, ...that we are not perceived as 
positively as competitors in the market 
place,” Ryan, 2003, p. 21). The solution 
generally proposed is to promote our 
putatively superior education and train- 
ing. | have tried to show that that is an 
ineffective treatment based on a misdi- 
agnosis of the nature of the crisis. | be- 
lieve the malady relates to our inade- 
quate and biased core professional iden- 
tity, defined as our “beliefs, goals, and 
meta-objectives concerning what it is 
[we] intend to accomplish in the organi- 
zations with which [we] work and how 
[we] prefer to go about accomplishing 
them” (Lefkowitz, 2010, p. 294). 


Our core professional identity, there- 
fore, is reflected in our strategic goals 
which are to: (a) “become the premier 
and trusted authority on work-related 
human behavior;” (b) “increase the 
awareness and use of l-O psychol- 

ogy;” (c) “meet the needs of those en- 
gaged in the science and practice of I-O 
psychology throughout their careers;” 
and (d) “model and reinforce the effec- 
tive integration of science and prac- 
tice” (SIOP, 2013). It would be compel- 
ling to add explicitly something to the 
effect that we are equally concerned 
with assuring that the organizations with 
which we work “are safe, just, healthy, 
challenging, and fulfilling places in which 
to work” (Lefkowitz, 2013, p. 36). 


Another Illustration: 
What/Whom We Don’t Study 


Ruggs et al. (2012) have recently pointed 
out a noteworthy set of omissions re- 
flected in the relative lack of published 
research in l-O concerning seven margin- 
alized and/or stigmatized groups (e.g., 
ethnic minorities other than Blacks; those 
who are heavy; religious minorities). It’s 
difficult to imagine finding fault with the 
authors’ admonition that I-O psycholo- 
gists should correct the omissions in order 
to advance the cause of workplace rights 
for all. Perhaps more important, however, 
one might expand considerably the list of 
ostensibly relevant groups, organizations, 
and topics not studied much in I-O psy- 
chology. If so, what might account for 
these omissions? The well-intended en- 
couragement to conduct more such re- 
search offered by Ruggs et al. may be in- 
adequate because they fail to recognize 
the complicit values bias in I-O that plays 
a contributing role. 


The following may be examples of other 
relevant domains in which I-O psychol- 
ogy has produced a dearth of research: 
(a) organizations other than business 
corporations (e.g., nonprofit, NGOs, 
education, health); (b) the nontradi- 
tional or “contingent” workforce; (c) the 
unemployed; (d) labor unions; and (e) 
home workers. In order to investigate 
whether there might be some veracity 
to these impressions, | conducted an 
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attenuated version of the methodology 
used by Ruggs et al. They reviewed 20 
years of published research in seven I-O 
journals, beginning in 1990. Fully one- 
third of the articles they found concern- 
ing the seven marginalized groups (19 of 
57) were from Journal of Applied Psy- 
chology. So | surveyed the same 20 years 
of publications in (only) JAP, looking for 
articles concerning the above five 
groups/organizations. 


My results are comparable to theirs: | 
found only 18 articles. Nine concern la- 
bor unions or union members; five are 
about the unemployed; three focus on 
noncorporate organizations (two on 
mental health workers, one on school- 
teachers); and one is a study of nontra- 
ditional workers (so-called “bridge em- 
ployees” who have ended full-time em- 
ployment but not yet retired). No stud- 
ies were found of those who work from 
home. 


This arguably suggests two things: (a) 
there are probably more, perhaps many 
more, such pertinent omissions. (I invite 
the reader to lengthen the list.); (b) it is 
likely that they are not random or 
“chance” omissions—that they reflect 
some underlying dynamic. | nominate 
the implicit professional value system of 
I-O psychology, so that these domains 
might more accurately be thought of as 
“exclusions” rather than “omissions,” 
implying some intentionality. 
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To their credit, Ruggs et al. (2012) close 
their essay with a consideration of possi- 
ble reasons for these omissions. They 
conclude that, “There are challenges to 
conducting research on marginalized 
groups and these reasons may help ac- 
count for the fact that I-O psychologists 
have been slow to conduct such re- 
search” (p. 55). They go on to itemize five 
sets of reasons, several of which are 
methodological (e.g., it’s difficult to find 
and collect data on discrimination; some 
stigmas are not readily apparent), focused 
on the nature of the publication enter- 
prise (editors have been reluctant to pub- 
lish research on marginalized groups), or 
may require greater familiarity with legal 
issues than with which I-O psychologists 
are comfortable. Each of these might 
have some validity but, even taken all 
together, they seem insufficient and/or in 
need of further explanation: For example, 
why might editors of I-O journals be re- 
luctant to publish research on unfair 
discrimination? 


A reason they offer that may contribute 
more explanatory variance is the observa- 
tion that, “Top management is under- 
standably cautious about approving and 
giving access to the investigation of dis- 
crimination-related issues within their 
organizations” (p. 55). However, possible 
management reluctance would seem to 
have little relevance to the five additional 
exclusions | introduced above—none of 
which entail possible managerial culpabil- 


ity or potential corporate legal vulnerabil- 
ity. Moreover, if accurate, it raises the 
interesting derivative question of whether 
l-O psychologists (a) have actually been 
requesting such access and been turned 
down, (b) have deferentially refrained 
from making such requests, or (c) actually 
share managers’ caution and lack of con- 
cern. The latter two options imply some- 
thing of the intentionality (a shared value 
system) noted previously. 


It has been observed recently that 

It is a profession’s values that determine 
its goals and self-construed duties, re- 
sponsibilities, and ethical standards, its 
response to sociopolitical events that 
affect it (e.g., civil rights legislation; ram- 
pant downsizing), and the choices made 
by its members concerning where they 
work, what they study, and the criteria 
by which they evaluate that work. 
(Lefkowitz, 2008, p. 440, emphasis 
added) 


Of course, with the hindsight provided 
by Ruggs et al. (2012), | could have been 
more explicit to the effect that a profes- 
sion’s values also influence “choices... 
concerning...where they [do not] work... 
what they [do not] study, and the crite- 
ria...they [do not use to] evaluate that 
work.” 


This is reminiscent of the recent essay 
by Scherbaum et al., (2012) who la- 
mented the relatively modest amount 


and quality of research conducted by I-O 
psychologists on the critical construct 
intelligence, in comparison with our in- 
ordinate focus on merely using meas- 
ures of the construct for employee se- 
lection. They also opined that most of 
what we know about the construct has 
been produced by researchers in other 
fields and published in non-l-O journals. 
A short time later | asserted that similar 
criticisms could be made regarding other 
constructs appearing in the I-O literature 
and that it reflected a pervasive values 
orientation characterized in part by the 
preeminence of practice over theoretical 
research and conducted from a corpo- 
rate perspective (Lefkowitz, 2012b). In 
other words, our focus on satisfying or- 
ganizations’ needs not only determines 
the nature of our professional practice 
but much of our science agenda as well. 


Ruggs et al. (2012) did not include re- 
search on Blacks among their omissions 
because that topic is ostensibly well- 
represented in I-O publications. But | 
wonder how well-represented the topic 
actually is aside from investigations of 
various aspects of test usage for em- 
ployee selection—such as elucidating 
discriminatory organizational practices. 
A personal anecdote provides an illustra- 
tion. In the course of conducting a selec- 
tion test validation study some years 
ago, something interesting was noticed 
in the data. There was a statistically sig- 
nificant tendency for newly hired em- 
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ployees of the company to be assigned 
to supervisors of the same ethnicity. 
Moreover, among those who were reas- 
signed within their first 5 months on the 
job, the level of such ethnic correspon- 
dence increased significantly further. 
(Interestingly, the management of the 
company professed no knowledge of 
this process.) A write up of this never- 
before-reported phenomenon was re- 
jected for publication by one of the edi- 
tors of a preeminent I-O journal as an 
inappropriate topic for the journal! (It 
was suggested that the manuscript be 
submitted to a political science journal.) 
It was nevertheless subsequently pub- 
lished (Lefkowitz, 1994). Almost 20 years 
later, a special issue of Journal of Social 
Issues was devoted to contemporary 
real-world discrimination in the United 
States (Nier & Gaertner, 2012). Two sec- 
tions contain a total of five articles on 
employment contexts and legal con- 
texts. Those articles have 12 coauthors, 
none of whom are members of SIOP. 


The possible explanations offered by 
Ruggs et al. (2012) for the “omissions” 
they note seem inadequate. They imply a 
mere disinterest or benign neglect on the 
part of I-O psychologists so that we are 
characterized as having “missed a great 
opportunity” or that “we have gone fish- 
ing” and are advised that, “It is really time 
to act” (p. 57). But it is likely that some- 
thing much more tendentious is going on 
that needs to be recognized. Otherwise, 
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the “hope that researchers will devote 
more attention to these and other mar- 
ginalized groups” (p. 56, emphasis added) 
is not likely to be fulfilled. 


The authors note just how important this 
research on prejudice can be by empha- 
sizing that, “Consumers of the results of 
these studies can use the findings to alter 
the work environment and assist the 
Equal Employment Opportunity Commis- 
sion to meet its mandate of removing 
discrimination from the work place.... The 
findings [could be used] to modify the 
work environment either directly through 
action in the workplace, or indirectly 
through action that regulates and controls 
the context of work” (p. 56). But how 
likely are such activities in the cause of 
social justice, challenging management 
prerogatives, if they are antithetical to the 
prevailing values of the field? Although | 
am cautiously optimistic that those pre- 
vailing values may be shifting (cf. Carr, 
MacLachlan, & Furnham, 2012; Olson- 
Buchanan, Koppes Bryan, & Thompson, 
2013), it remains to be demonstrated 
more substantially. 


Conclusions and Recommendations 


What is the substance of the I-O value 
system | allege? Only a brief summary is 
possible here; some characterizations 
have been offered previously (Lefkowitz, 
1990, 2003, 2005, 2009, 2011b, 2012a, 
2013; Lefkowitz & Lowman, 2010). 


There appear to be two multifaceted 
and interdependent dimensions, one of 
which has been alluded to above. 


I-O Psychology’s Managerialist/ 
Corporate Bias 

It is known that large numbers of l-O psy- 
chologists are consultants to or managers 
of large corporations. Given what we know 
about vocational choice, secondary sociali- 
zation, and reinforcement processes, it is 
not surprising to find that corporatist val- 
ues are dominant in l-O psychology. How- 
ever, what is worth exploring is, from a 
multiple stakeholder ethical perspective: 
how these values have articulated with 
and largely displaced the more individualis- 
tic, humanistic and social justice values 
long associated with psychology (Kimball, 
1992; Kimble, 1984; Vasquez, 2012); how 
and why the profession has remained 
largely oblivious to and/or sanguine about 
such bias; whether this is something that 
should be changed; and if so, what might 
be done about it (Lefkowitz, 20114; 
Muchinsky, 2006). A more considered ex- 
ploration of all of that is well beyond the 
scope of this essay. 


The Myth of l-O Psychology as Entirely 
Scientific and Value Free 

The belief that science is and must be 
completely free of all subjectivity and 
values stems from the logical positivist 
perspective as manifested in the physi- 
cal sciences, although that assumption 
has certainly been contested in recent 


years (e.g., Howard, 1985). In any event, 
the belief becomes less and less tenable 
as one moves along a continuum 
through the biological sciences, social 
science, applied social science, and 
eventually to professional practice in |-O 
(cf. Lefkowitz, 2003, Ch. 9, for a fuller 
consideration). 


The tenacity with which I-O psychology 
clings to the image of objective, value- 
free, “good science” probably stems 
from defensive reactions to early 
charges of being unscientific: “this com- 
mitment to management’s goals...did 
color their research and recommenda- 
tions...it seems that making a contribu- 
tion to knowledge has been the essen- 
tial purpose of only a few industrial so- 
cial scientists” (Baritz, 1960, p. 197). | 
believe that we maintain the myth in 
part by conflating the procedural trap- 
pings of objectivity (emphases on meas- 
urement, quantification, sophisticated 
statistical methodology, quasi- 
experimentation) with being value free. 
But the Nobel Laureate in economics, 
Friedrich Hayek (1989) warned his fellow 
economists and other social scientists 
against “happily proceed[ing] on the 
fiction that the factors which they can 
measure are the only ones that are rele- 
vant” (p. 3). Scientific methods alone are 
no safeguard against unacknowledged 
subjective bias. It also conflates instru- 
mental values with terminal values 
(Rokeach, 1973). 
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Moreover, such misapplied scientism has 
adverse effects. For example, Rosenberg 
(1995), a philosopher of social science, 
noted that, “A social science that sought to 
efface the moral dimension from its de- 
scriptions and explanations would simply 
serve the interests of some other moral 
conception” (p. 205)—which is | suspect 
exactly what has happened to the I-O facet 
of psychology. Our eagerness to banish all 
subjectivity from the enterprise created a 
moral vacuum into which economically 
driven corporate values flowed, were wel- 
comed, and yet not overtly acknowledged. 
Our science is not value free because it is 
shaped largely by the economic values of 
our professional practice. And the fact that 
it is a values position has gone largely un- 
recognized, as revealed by the following: 
“Humanistic values represent a problem 
for the field of organizational psychology 
because these features can conflict with 
the objectivity required of a science and 
because they can dilute a strong concern 
for performance effectiveness and produc- 
tivity’ (Miner, 1992, p. 293). “A strong con- 
cern for performance effectiveness and 
productivity” is, of course, a subjective 
values position. 


Similarly, the criteria by which we evalu- 
ate our own work are limited almost en- 
tirely to indicators of technical (i.e., scien- 
tific) competence and instrumental (i.e., 
economic) effectiveness. Omitted, for the 
most part, are its societal consequences 
for all stakeholders affected. For exam- 
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ple, we evaluate an employee selection 
program by its utility—that is, its effec- 
tiveness in increasing the proportion of 
successful employees hired. “But we 
should also be concerned about the pro- 
portion of incorrectly rejected applicants 
who have been denied employment 
(‘false negatives’) due to the imperfect 
validity of those predictors” (Lefkowitz & 
Lowman, 2010; p. 575). 


Certainly, there is room for legitimate dis- 
agreement about these matters. Some I-O 
psychologists probably believe that in the 
context of our professional work it would 
be improper and/or virtually impossible to 
engage in any social justice advocacy. Oth- 
ers perhaps believe that there is an advo- 
cacy role for us to play but only if it is 
based on good scientific data. Some of us 
may believe that it is appropriate—even 
imperative—to do so even in the absence 
of a data-based rationale if there are mor- 
ally compelling reasons. But avoiding tak- 
ing a stand, doing nothing, is of course 
taking action—in support of the status 
quo. And, at the risk of being repetitious, 
it’s necessary to acknowledge that the 
status quo represents a very dominant 
values position. Only then will it be possi- 
ble to frame a discussion in terms of which 
sets of potentially competing values 
should be recognized and implemented, 
and whether they might not be contradic- 
tory—rather than perpetuating the bogus 
conflict between “[objective/pure] science 
versus [subjective/biased] social values.” 
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In the previous four issues of TIP, we 
provided a general overview of the 2011 
survey of graduate programs in I-O psy- 
chology (October, 2012), and detailed 
coverage of admissions practices 
(January, 2013), curriculum and compe- 
tencies, (April, 2013), and internships 
(July, 2013). In this, the fifth, installment 
we turn to comprehensive exams. 


Historically, comprehensive (aka 
“qualifying”) exams are the byproduct of 
middle-age scholasticism advanced by 
King Charlemagne (742-814 AD) in 
Europe. By the early 1800s, German uni- 
versities had developed intellectual as- 
sessments to protect the integrity of 
student achievements and the reputa- 
tions of teachers and institutions 
(Goodchild & Miller, 1997). The oral ex- 
amination emerged from debates with 
the “master” as a way of demonstrating 
knowledge of key material (Manus, 
Bowden & Dowd, 1992). The modern 
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comprehensive exam format, including 
both written and oral tests, can be 
traced to Yale’s first awarded doctoral 
degree in 1861 (in physics) and the ubiq- 
uitous Harvard Model of 1871, which 
first sought to standardize graduation 
requirements formally (Manus et al., 
1992; Rudolph, 1965). 


As we have seen in other domains of 
l-O graduate education, there is consid- 
erable diversity across l-O programs in 
comprehensive exam policies and proce- 
dures. Consistent with traditional prac- 
tices, most include a combination of 
written and oral tests conducted over 
several days with a 4-8 hour time limit 
each day. Survey results offer finer 
grained descriptions of the nature and 
practice of comprehensive exams in I-O 
psychology as of 2011. 


Before turning to specifics, we repeat 
several points noted in earlier install- 


ments: (a) Norms are offered only for 
American programs, as the numbers of 
other programs are too low to allow 
meaningful representation. (b) Norms 
offered at the most general level include 
responses from all participating 
(American) brick-and-mortar, online 
only, and mixed programs. (c) Norms are 
broken out in a 2-by-2 array, crossing 
master’s versus doctoral programs with 
psychology versus business/ 
management departments. (d) Online- 
only programs are excluded from the 2- 
by-2 breakouts. (e) Norms are also pro- 
vided separately for three “top-10” lists 
identified by Gibby, Reeve, Grauer, 
Mohr, and Zickar (2002; most productive 
doctoral programs), and by Kraiger and 
Abalos (2004; top master’s and doctoral 
programs, separately, based on student 
ratings). (f) When N falls below three for 
a given subgroup, norms are not pro- 
vided due to dubious representative- 
ness. (g) Means, standard deviations, 
medians, and skewness, min, and max 
values are reported for continuous vari- 
ables; frequencies and percentages are 
offered for nominal. (h) Statistically, t- 
tests are used for comparisons involving 
continuous variables and chi squares for 
nominal variables. (i) Finally, as compre- 
hensive exams were rarely reported by 
master’s programs in business/ 
management departments, comparisons 
are limited to master’s versus doctoral 
programs within psychology depart- 
ments, and doctoral programs in psy- 


chology versus business/management 
departments. 


Results are organized in separate tables 
for nominal and continuous variables and 
then within tables in terms of (a) general 
exam features, (b) exam preparation, (c) 
grading processes and outcomes, and (d) 
specific exam component features (i.e., 
written, quant/analytic, oral). 


General Exam Features 


Table 1 presents norms for all programs 
and by degree and department types for 
nominal variables, and Tables 2, 3, and 4 
present corresponding norms for con- 
tinuous variables. General features are 
described at the top of each table. Be- 
ginning with Table 1, we see that all doc- 
toral programs offer comprehensive ex- 
ams compared to only 41% of 
(psychology) master’s programs. Not 
surprisingly, given their different time- 
lines, master’s programs offering comps 
tend to do so in the second year of study 
(87%), whereas doctoral programs tend 
to offer them in the third (70%) or 
fourth (22%) years. Results at the top of 
Table 2 show that exam frequency varies 
considerably across programs, some of- 
fering comps apparently on an optional 
basis (0 times in the past 5 years), others 
offering them 3 times per year. This pat- 
tern is not significantly different across 
degree and department types (see Ta- 
bles 3 and 4). 
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Table 1 
Main Comprehensive Exam Features: Nominal Variables 


Psychology 
All programs? Master's” Doctoral” Bus/mgmt. doctoral” 
Item/variable N Freq % N Freq % N Freq % sig. N Freq % sigt 
General features 
Comprehensive exam included 
in program 125 82 65.6 56 23 41.1 40 40 100.0 ** 11 11 100.0 
Year of study exam is administered se 
First 82 3 3.7 23 2 87 40 1 2.5 = 11 0 .0 = 
Second 82 30 366 23 20 87.0 40 2 5.0 = 11 4 364 = 
Third 82 38 463 23 0 0 40 28 70.0 = 11 7 63.6 = 
Fourth 82 11 134 23 1 43 40 9 22.5 = 11 0 .0 = 
Fifth or later 82 0 0 23 0 .0 40 0 .0 = 11 0 .0 = 
Preparation 
Acceptable sources of exam questions “* 
Material covered only in 
required courses 70 21 30.0 19 9 474 37 7 18.9 = 9 2 18.2 = 
Material covered only in 
available courses 70 12 171 19 5 263 37 4 108 = 9 3 27.3 = 
Targeted areas, including 
outside available courses 70 37 52.9 19 5 263 37 26 70.3 = 9 4 364 = 
Guidance offered to students for exam preparation 
No formal guidance offered 75 8 10.7 21 5 23.8 38 3 7.9 10 0 0 
Written descriptions in 
student handbooks 75 42 560 21 11 524 38 #19 50.0 10 7 700 
Sample exams 75 49 653 21 9 429 38 28 737 * 10 9 90.0 
Standardized reading lists 75 28 37.3 £21 9 429 38 14 368 10 4 40.0 
Presentations 75 8 10.7 21 3 143 38 4 105 10 0 .0 
Individualized one-on-one 
preparation 75 34 453 21 9 429 38 18 474 10 5 500 
Grading process & outcomes 
How are exams graded? Performance is judged... - - 
per component using a single 
global scale 72 25 34.7 20 4 200 37 14 37.8 9 6 66.7 
per component using multiple 
scales 72 8 11.1 20 2 10.0 37 5 13.5 9 0 .0 
per component separately per 
question 72 41 569 20 10 500 37 22 59:5 9 5 55:6 
as simple pass/fail 72 25 347 20 10 500 37 12 324 9 1 111 
with passing further 
distinguished as weak vs. 72 23 319 20 7 35.0 37 13 35.1 9 2 222 
by averaging across raters 72 30 417 20 8 40.0 37 18 48.6 9 3 33.3 
Students req'd to complete 
components before advancing 68 22 324 18 5 278 36 12 33.3 11 5 45.5 
Remedial assignments offered to students who fail - - 
None 59 28 475 17 8 47.1 30 15 50.0 8 2 25.0 
Take-home assignment 
targeting particular area(s) 59 30 508 17 8 47.1 30 16 53.3 8 4 50.0 
Separate "in-class" exam 
targeting particular area(s) 59 6 10.2 17 1 59 30 3 10.0 8 2, - 250 


“Excluding non-US. 

Excluding non-US and online only. 

‘Chi square significance test comparing master's vs. doctoral psychology programs; *p <.05, **p <.01, two-tailed. 

8Chi square significance test comparing psychology vs. business/management doctoral programs *p <.05, **p <.01, two-tailed. 
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Table 2 
Main Comprehensive Exam Features: Continuous Variables 


Item/Variable N Mean SD Skew Median Min Max 
General features 
Times exam offered in the last5 yrs. 79 682 3.65 53 5.0 0 15 
Time allowed for completion 
Written (proctored/sit-down; hours) 48 5.28 2.98 1.25 ** 40 10 16 
Quant/analytic (proctored/sit-down; hours) 20 3.76 2.21  .88 40 8 8 
Oral (hours) 29 2.03 1.00 79 2.0 8 4 
Written take-home (days) 28 11.91 19.88 2.94 ** 40 2.0 90 
Quantitative/analytic take-home (days) 6 18.50 35.11 2.42 * 50 5 90 
Time separating components (days) 
Time between components 1 and 2 45 7.20 12.29 3.26 ** 10 O 67 
Time between components 2 and 3 16 8.88 12.05 1.78 ** 45 0 42 
Time between components 3 and 4 4 3.50 4.36 1.93 15 2 10 
Preparation 
Exam scheduling rigidity“ 80 2.80 1.32 -1.02 ** 3.0 0 4 
Grading process & outcomes 
# of faculty graders involved 75 494 2.19 57 * 40 1 10 
# of faculty graders per component 
Written 72 450 2.22 .69 * 4.0 1 10 
Quantitative/analytic 26 3.44 1.30 61 40 2 7 
Oral 32 3.72 1.20 35 4.0 2 6 
# of times students allowed to take each component 
Written 70 1.95 55 +53 2.0 1 3 
Quantitative/analytic 24 1.88 61 .06 20 1 3 
Oral 33. 194 61 .03 2.0 1 3 
% of students per cohort asked to retake 
Written 62 17.27 20.72 1.84 ** 10.0 O 100 
Quantitative/analytic 24 17.98 22.39 1.67 ** 100 0 75 
Oral 29 5.35 8.01 2.49 ** 25 0 35 
% of students per cohort who fail exam 67 2.77 446 2.35 ** 1.0 0 20 


Written exam 
% grade per item type 


Multiple choice 71 458 20.40 4.52 ** .0 oO 100 
Fill-in-the-blank 71 .00 .00 .00 0 0 0 
Short-answer (1 word to 1-2 sentences) 71 99 4.90 5.12 ** Oo 0 30 
Medium-answer (1-2 para's;50-300 words) 71 3.45 14.77 5.10 ** © 0 100 
Short essay (1-2 pp.; 300-600 words) 71. 9:37 2230 259 ** © 0 100 
Medium essay (2-5 pp.; 600-1500 words) 71 39.93 45.91 44 © 0 100 
Long essay (5-10 pp.) 71 33.52 44.47 10: * © 0 100 
Article-length papers (10-30 pp.) 71 8.17 25.15. 3.10 ** © 0 100 


Excluding non-US. *p <.05, **p <.01, two-tailed 


“0: as needed at any time ofthe year; 1: at any time of the year except summer; 2: preferred times but may be 
changed; 3: default regular times, rare exceptions; 4: offered only at default times, no exceptions 
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Table 3 
Main Comprehensive Exam Features: Continuous Variables in Master's and Doctoral Programs in Psychology 


Departments 
Master's programs Doctoral programs 
ltem/Variable N Mean SD Skew Median Min Max N Mean SD Skew Median Min Max sig. 
General features 
Times exam offeredinlast5y22 6.23 3.68 1.16 * 5.0 0 15 40 7.35 3.36 19 75 O 15 
Time allowed for completion 
Written (proctored/sit- 
down; hours) 15- 332 1:90. 1.02 3.0 8 8.0 23 6.78 3.10 1.37 * 6.0 3.0 16.0 ** 
Quant/analytic 
(proctored/sit-down; 7 225 116 1.25 2.0 8 4.0 9 444 2.13 1.15 40 2.0 8.0 * 
Oral (hours) 8 156 1.24 1.54 1.0 5 40 17 2.26 94 98 20 10 40 
Written take-home (days) 3 667 635 1.73 3.0 30 140 19 15.13 23.51 2.33 ** 7.0 2.0 90.0 


Quantitative/analytic 

take-home (days) 2 3.00 00 .00 30 30 30 3 32.67 49.74 1.70 7.0 1.0 90.0 
Time separating components (days) 

Time between 


components 1 and 2 10 2.70 4.03 1.46 1.0 0 10 26 560 6.37 1.37 ** 30 0 25 
Time between 

components 2 and 3 4 450 480 .29 4.0 0 10 12 10.34 13.51 1.47 * 45 0 42 
Time between 

components 3 and 4 1 1.00 .00 .00 1.0 1 1 3 433 4.93 1.65 20 #1 10 - 


Preparation 
Exam scheduling rigidity‘ 21) 3324 211.-1.53:** 30 0 4 40 2.85 1.29 -1.28 ** 30 0 4 
Grading process & outcomes 


# of faculty graders involved 20 4.00 2.39 1.15 * 33 í 10 39 5.10 1.83 .57 50. 2 10 # 
# of faculty graders per component 
Written 18 3.78 2.35 1.34* 33 1 10 38 4.71 199 69 40 2 10 
Quantitative/analytic 6 3.25 99 -82 38 2 4 13 3.62 104 -62 40 2 5 
Oral 8 3.13 1.36 1.54 30 2 6 18 400 1.09 31 40 2 6 # 
# of times students allowed to take each component 
Written 18 2.06 42 47 209 i 3 36 2.00 54 00 20 1 3 
Quantitative/analytic 7 1.86 38 -265** 2.0 1 2 11 1:91 70 12 20 1 3 
Oral 8 2.00 54 .00 20 1 3 19 2.00 .67 00 20 1 3 
% of students per cohort asked to retake 
Written 18 16.25 23.10 1.75** 65 0O 75 30 13.92 1341 96 * 100 © 50 
Quantitative/analytic 8 16.56 24.24 2.54** 100 0 75 10 11.30 1044 475 100 0 30 
Oral 8 2.19 2.10 .28 23 D 5 16 484 648 2.24 ** 23 0 25 
% of students per cohortwho 19 1.16 2.31 3.42 ** 0 O 10: 33: 2:89 498- 2.70: ** 10 0 20 


Written exam 
% grade per item type 


Multiple choice 19 11.84 31.59 2.65 ** © 0 100 36 .00 00 00 0o 0 0 
Fill-in-the-blank 19 .00 00 =.00 0 0 0 36 .00 00 00 0 oO 0 
Short-answer (1 word to 

1-2 sentences) 19 2.11 652 3.13 ** 0 0 25 36 .83 5.00 6.00 ** 0 O 30 
Medium-answer (1-2 

para's; 50-300 words) 19 868 25.05 3.25 ** o O 100 36 1.39 833 6.00 ** 0 0 50 
Short essay (1-2 pp.; 300- 

600 words) 19 14.21 27.95 2.07 ** © O 100 36 7.08 20.51 3.39 ** 0 O 100 
Medium essay (2-5 pp.; 

600-1500 words) 19 35.79 4659 67 © O 100 36 45.14 47.23 22 27.5 0 100 
Long essay (5-10 pp.) 19 27.37 4483 1.14* 0 0O 100 36 34.17 43.71 66 0 0O 100 
Article-length papers (10- 

30 pp.) 19 00 00.00 0 p 0- 36 11.39 29.97 2.49 ** Oo -0 100 * 


Excluding non-US and online only. *p <.05, **p < .01, two-tailed 
’Comparing master's and doctoral program means within psychology departments using the t-test; #p <.10, *p <.05, ** p <.01, two-tailed. 


“0: as needed at any time of the year; 1: at any time of the year except summer; 2: preferred times but may be changed; 3: default regular times, rare exceptions; 
4: offered only at default times, no exceptions 
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Table 4 
Main Comprehensive Exam Features: Continuous Variables in Business/Management 


Doctoral Programs 
Item/Variable N Mean SD Skew Median Min Max sig. 


General features 
Times exam offered in last5 yrs. 10 5.70 3.95 1.43 50 <0 15 
Time allowed for completion 


Written (proctored/sit-down; hours) 5 600 2.00 .00 6.0 4.0 8.0 
Quant/analytic (proctored/sit-down; hours) 3 6.00 2.00  .00 6.0 4.0 8.0 * 
Oral (hours) 3. 217 29 1.73 2.0 20 25 
Written take-home (days) 4 3.00 1.16 .00 3.0 2.0 4.0 
Quantitative/analytic take-home (days) 0 - - - - - - - 
Time separating components (days) 
Time between components 1 and 2 6 25.08 25.11 96 19.0 1 67 
Time between components 2 and 3 0 - - - - - - - 
Time between components 3 and 4 0 - - - - - - - 
Preparation 
Exam scheduling rigidity“ 11 1.91 1.38 .20 20 0 4 * 
Grading process & outcomes 
# of faculty graders involved 10 7.05 1.92 .74 63 5 10 ** 
# of faculty graders per component 
Written 10 640 1.78 1.32 6.0 5 10 * 
Quantitative/analytic 3 5.00 2.00 .00 50 3 7 
Oral 4 400 1.41 -1.41 45 2 5 
# of times students allowed to take each component 
Written 10 1.80 63 13 2.0 1 3 
Quantitative/analytic 2 2.00 1.41 .00 2.0 1 3 
Oral 4 1.75 50 -2.00 20 1 2 
% of students per cohort asked to retake 
Written 9 32.78 30.73 1.38 30.0 0O 100 
Quantitative/analytic 2 62.50 17.68  .00 62.5 50 75 a 
Oral 3 833 7.64 -94 10.0 O 15 
% of students per cohort who fail exam 9 611 5.46 19 50 0 15 # 
Written exam 
% of written exam grade per item type 
Multiple choice 10 .00 .00 .00 Oo O 0 - 
Fill-in-the-blank 10 .00 00 ~=.00 0 0 0 - 
Short-answer (1 word to 1-2 sentences) 10 00 00 .00 0 0 0 
Medium-answer (1-2 para's;50-300 words) 10 3.00 9.49 3.16 ** 0 0 30 
Short essay (1-2 pp.; 300-600 words) 10 9.00 19.12 1.85 * 0 0 50 
Medium essay (2-5 pp.; 600-1500 words) 10 28.00 41.58 1.21 © © 100 
Long essay (5-10 pp.) 10 45.00 49.72 .24 25.0 0 100 
Article-length papers (10-30 pp.) 10 15.00 33.75 2.28 ** © 0O 100 


Excluding non-US and on-line only. *p <.05, **p <.01, two-tailed 
*t -test comparing Psychology vs. Business/Management Doctoral programs; #p <.10, *p <.05, **p <.01, two-tailed. 


“0: as needed at any time of the year; 1: at any time of the year except summer; 2: preferred times but may be changed; 3: default 
regular times, rare exceptions; 4: offered only at default times, no exceptions 
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Table 5 
Exam Component-Specific Features: Nominal Variables 


Psychology 
All programs? Masters” Doctoral” Bus/mgmt. doctoral” 
ItemyVariable N Freq % N Freq % N Freq % sig” N Freq % sig 
General features 
Components administered - - 
Written (proctored/sit-down) 77 73 948 22 20 909 38 36 947 11 11 1000 
Quantitative/analytic (proctored/sit-down) 77 31 403 22 9 409 38 14 368 11 4 36.4 
Oral 77 35 455 22 9 409 38 21 553 11 3 27.3 
Written take-home 77 29 377 22 4 18.2 38 19 500 < 11 4 36.4 
Quantitative takehome 77 6 78 22 2 91 38 3 7.9 11 o 0 
Written exam 
Choice afforded to students 
No choice: all items mandatory 73 23 315 20 11 550 37 9 243 - 10 1 10.0 - 
Limited choice: eg., answer these 5, plus 1of2 73 24 329 20 4 200 37 12 324 - 10 4 40.0 - 
Moderate choice:e.g., answer 3 of 5 (plus 30f5) 73 26 35.6 20 5 250 37 16 432 - 10 5 50.0 - 
Considerable choice: e.g., answer 1 of 4 (plus 1 
of 4) 73 o 0 20 o 0 37 o 0 aaa 10 o 0 = 
Quantitative/analytic exam 
Format = = 
Realistic data set with client-type questions 26 8 308 9 4 444 11 3 273 4 1 25.0 
Students expected to test statistical 
assumptions 7 3 42.9 4 1 25.0 3 2 333 e 1 o 0 e 
Data entry errors screened out prior to exam 7 4 57.1 4 b 25.0 3 2 66.7 e 2 o 0 e 
Students prepareclient-friendly report 41 12 293 12 5 417 21 6 286 5 Qo 0 
Conceptual questions on particular analytic 
methods 41 34 829 12 8 667 21 19 905 5 1 20.0 = 
"Fair game" content areas - - 
Basic research methods 50 46 920 14 13 929 24 22 917 6 6 1000 
Advanced research methods 50 34 680 14 9 643 24 18 75.0 6 5: 83.3 
Basic descriptives (e.g., means, SDs) 50 37 740 14 12 857 24 18 75.0 6 4 66.7 
Correlation 50 43 860 14 14 1000 24 20 83.3 6 5 83.3 
Chi Square 50 32 640 14 9 643 24 16 66.7 6 4 66.7 
ANOVA (one-way, two-way, multi-way) 50 43 860 14 13 929 24 20 83.3 6 5 83.3 
Regression (simple, hierarchical) 50 46 92.0 14 14 1000 24 22 91.7 6 6 1000 
Multivariate analysis (e.g, MANOVA, 
canonical r) 50 31 620 14 5 35.7 24 19 79.2 = 6 5 83.3 
Psychometrics 50 38 760 14 10 714 24 21 875 6 4 66.7 
Test deve opment 50 27 540 14 10 714 24 #15 62:5 6 1 16.7 ba 
Factor analysis (PCA, CFA) 50 35 700 14 9 643 24 21 875 6 3 50.0 * 
Item response theory so 15 300 14 2 143 24 12 500 - 6 o 0 + 
Generalizability theory 50 15 300 14 3 214 24 10 417 6 o 0 
Meta-analysis 50 19 380 14 3 214 24 11 458 6 3 50.0 
Structural Equation Modding 50 22 440 14 1 7.1 24 16 667 had 6 3 50.0 
Hierarchical Linear Modding 50 17 340 14 1 7.1 24 13 542 a 6 1 16.7 
Nonparametric statistics 50 14 280 14 5 35.7 24 7 29.2 6 o oO 
Qualitative methods 50 13 260 14 1 7.1 24 8 333 6 2 33.3 
Oral exam 
Format = = 
Highly structured: same material, same order 32 5 15.6 8 2 250 18 3 167 4 o o 
Examiners discuss strategy/standards for 32 8 250 8 2 250 18 6 333 4 o 0 
Examiners discuss strategy/standards per 2 42 #375 8 4 50.0 18 5 278 4 3 75.0 
Each student reviews own perf. on earlier 
components 32 16 50.0 8 3 375 18 10 556 4 l 75.0 
Questions on students’ perf. on earlier 
components 32 #17 «53.1 8 4 500 18 10 556 4 1 25.0 
Examiners limited to set number of questions 32 4 125 8 1 125 18 2 114 4 oO 0 
Examiners follow-up on lines of questioning 32 27 844 8 7 875 18 15 833 4 4 1000 
Hints or assistance provided to struggling 
students 32 19 594 8 4 500 18 11 611 4 4 1000 
Explicitly understood as a learning opportunity 32 12 37.5 8 4 500 18 5 278 4 2 50.0 


“Excluding non-US. 

Excluding non-US and omine only. 

“Chi square significance test comparing master's vs. doctoral psychology programs; *p <.05, **p <.01, two-tailed. 

*Chi square significance test comparing psychology vs. business/management doctoral programs *p <.05, **p <.01, two-tailed. 
"Ns too small topermit analysis 
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Table 5 shows the frequencies and per- 
centages of programs including specific 
exam components. Proctored written ex- 
ams are most common (95%), followed by 
orals (45.5%), proctored quant/analytic 
exams (40%), and written take-homes 
(38%). Quant/analytic take-homes are 
used in just 8% of programs. These rela- 
tive proportions are not statistically differ- 
ent across degree and department types, 
except for the offering of written take- 
homes, which is almost three times as 
common in (psychology) doctoral than in 
master’s programs (50% vs. 18%). Return- 
ing to Table 2, we see that proctored writ- 
ten and quant/analytic exams average 
around 5.3 and 3.8 hours in length, on 
average, and oral exams average about 2 
hours. Students are given around 12 days, 
on average, to complete written take- 
homes (with notable variance around that 
mean) and 18.5 days for written quant/ 
analytic exams (again, with considerable 
variance). Results in Table 3 show that 
both proctored written and proctored 
quant/analytic exams are twice as long in 
doctoral than in master’s programs (i.e., 
6.8 vs. 3.3 hours and 4.4 vs. 2.3 hours, re- 
spectively). 


With respect to the spacing of exam 
components, the overall means suggest 
an average of about a week separating 
Parts 1 and 2, and another week sepa- 
rating Parts 2 and 3. The components 
appear to be more spread out in doc- 
toral than in master’s programs (e.g., 


mean = 2.7 vs. 5.6 days for the time 
separating parts 1 and 2), but the differ- 
ences are not significant. 


Exam Preparation 


The second section of Table 1 shows 
where programs draw their exam con- 
tent. Overall, 30% of programs limit con- 
tent to material covered only in required 
courses, and an additional 17% limit 
content to just available courses 
(regardless of whether or not they are 
required). Most programs (53%) include 
exam content falling outside of available 
courses. Thus, students in most pro- 
grams are expected to master at least 
some testable content on their own. A 
significant chi square suggests this holds 
especially in doctoral programs: 47% of 
master’s programs (vs. 19% of doctoral 
programs) restrict exam content to re- 
quired courses, whereas 70% of doctoral 
programs (vs. 26% of master’s pro- 
grams) look outside available courses. 
Doctoral students thus appear to be 
held more accountable for their own 
learning compared to master’s students. 
This might also reflect greater breadth in 
doctoral- versus master’s-level exam 
scope. 


As to guidance offered students as they 
study for comprehensive exams (see fur- 
ther down Table 1), around two-thirds of 
responding programs make sample exams 
available. This is especially common in 


October 2013 Volume 51 Issue 2 


(psychology) doctoral programs (74% vs. 
43% in master’s). Other relatively com- 
mon preparatory strategies include writ- 
ten descriptions (56% overall) and indi- 
vidualized regimens (45%). Standardized 
reading lists are maintained by 37% of 
programs, and 11% reported offering no 
preparatory aids. 


The second section in Table 2 shows 
overall norms for exam scheduling rigid- 
ity (rated on a O-to-4 scale), and Tables 3 
and 4 show breakouts by degree and 
department type. The overall mean of 
2.8 (Table 2) falls toward the rigid end of 
the scale (midpoint = 2.0; 3 = default 
regular times, exceptions rare). There is 
considerable variance across programs, 
however, some offering comps with no 
scheduling restrictions and others only 
at specific times (no exceptions). A sta- 
tistically significant t suggests that doc- 
toral programs in business/management 
departments are more flexible in sched- 
uling comps compared to those in psy- 
chology departments (means = 1.9 and 
2.9, respectively). Why this might be so 
is not obvious to us. 


Grading Processes and Outcomes 


We asked programs to tell us how they 
grade comprehensive exams in several 
procedural respects. Results in the third 
section of Table 1 show that 57% of pro- 
grams grade on a per-question basis per 
component, whereas around 35% evalu- 
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ate answers more globally, per compo- 
nent. A simple pass/fail criterion is used 
by 35% of programs, and 32% further dis- 
tinguish between strong and weak passes. 
Multiple raters’ judgments are averaged 
in 42% of programs. Around a third of 
programs use a multiple hurdle strategy, 
requiring students to pass earlier compo- 
nents before being offered later compo- 
nents. No significant differences on these 
process variables are evident across de- 
gree and department types. 


Turning to Tables 2, 3, and 4, we see that 
around five faculty members on average 
are involved in grading comprehensive 
exams. The mean is higher in (psychology) 
doctoral than master’s programs (5.1 vs. 
4.0, respectively) and higher in (doctoral) 
business/management than psychology 
programs (7.1 vs. 5.1). Not surprisingly, 
these differences parallel those in the 
numbers of core contributing I-O faculty 
(see initial October, 2012 installment: 
means = 3.5, 4.7, and 6.2, respectively). A 
doctoral/master’s difference (within psy- 
chology) is evident in the number of fac- 
ulty involved in conducting oral exams 
(means = 4.0 vs. 3.1, respectively), further 
reflecting the noted differences in faculty 
numbers. 


Referring again to Tables 2, 3, and 4, the 
median number of times students are 
permitted to take a given exam compo- 
nent is 2, which holds regardless of de- 
gree or department type. Averaging 


across all responding programs, 17% of 
students are asked to retake the written 
test, 18% the quant/analytic test, and 
5% the oral exam. Retake rates for doc- 
toral-level quant/analytic exams are sig- 
nificantly higher in business/ 
management departments (mean = 
62.5%) than in psychology departments 
(11.3%). The low N for business/ 
management (N = 2) in this case raises 
obvious concerns of generalizability. The 
overall comprehensive exam failure rate 
across all programs is a modest 2.8%. 
The rate for business/management doc- 
toral programs is significantly higher 
(6.1%; N = 9) than for psychology doc- 
toral programs (2.9%; N = 33). Further 
research would be needed to explain 
this difference (e.g., performance stan- 
dards vs. exam preparations vs. student 
self-selection into programs). 


Returning to Table 1 (bottom), around 
half of contributing programs offer reme- 
dial assignments targeting particular ar- 
eas, in lieu of outright failure. The most 
common such assignment is a take-home; 
10% of programs use a proctored exam. 
These remedial assignment practices do 
not vary significantly across degree and 
department types. 


Features of Specific 
Exam Components 


Written exam: The second section of 
Table 5 shows frequencies and percent- 


ages of programs offering different de- 
grees of choice to students on written 
exams. Of the four options, three each 
captured around a third of programs: no 
choice, limited choice, and moderate 
choice. Those relative frequencies do 
not vary significantly across degree or 
department types. The bottoms of Ta- 
bles 2, 3, and 4 show norms regarding 
the use of various exam item types. 


Medium-length essays (2 —5 pp.) consti- 
tute 40% of written exams, on average, 
and long essays, 33.5%. No program re- 
ported using fill in the blank. Multiple- 
choice format averages 4.5% of written 
exams (range = 0 to 100%) and article- 
length papers around 8% (range = 0 to 
100%). Papers average higher in 
(psychology) doctoral than master’s pro- 
grams (means = 11.4 vs. .0%, respectively). 


Quantitative/analytic exam: The third 
section of Table 5 offers frequency- 
based norms regarding both the format 
of quant/analytic exams and what 
counts as “fair game” for examination. 
As to format, 83% of programs include 
conceptual questions on quantitative 
and analytic methods (e.g., “Explain how 
analysis of variance works”). The propor- 
tion for psychology doctoral programs 
(19 of 21 = 90.5%) is statistically higher 
than the proportion for business/ 
management doctoral programs (1 of 5 
= 20%). Around 31% of responding pro- 
grams use simulated client scenarios 
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involving prepared datasets, with 
around half of those requiring students 
to test assumptions and/or deal with 
data entry errors. Small Ns preclude 
testing for differences between degree 
and department types on these latter 
variables. 


Exam content (i.e., “fair game”) norms 
show strong emphases on basic research 
methods (92%) and regression (92%), 
and, to lesser extents, ANOVA (86%), 
psychometrics (76%), factor analysis 
(70%), advanced research methods 
(68%), and multivariate methods (62%). 
This relative pattern, not surprisingly, 
closely mirrors that for course offerings. 
Correlating columns of percentages in 
Table 5 with corresponding columns of 
course frequencies (over the past 5 
years) in Tables 4—6 of the April, 2013 
installment (on curriculum and compe- 
tencies) yields r = .95 for all programs, 
.90 for psychology master’s programs, 
.93 for psychology doctoral programs, 
and .89 for business-management doc- 
toral programs (N = 15 content areas in 
each case). This level of correspondence 
suggests general adherence to a policy 
of testing what is taught, at least when it 
comes to quantitative/analytic methods. 


Several statistically significant differ- 
ences emerged in comparisons of fair- 
game content by degree and depart- 
ment types. (Psychology) doctoral pro- 
grams, predictably, are more likely than 
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master’s programs to test students on 
advanced methods, including multivari- 
ate analyses, IRT, SEM, and HLM. Psy- 
chology department (doctoral) programs 
are more likely than their business/ 
management counterparts to ask about 
test development, factor analysis, and 
IRT. A possible reason for the latter dif- 
ferences may be the special relevance of 
those methods in the psychological 
study of individual differences. 


Oral exam: The bottom of Table 5 shows 
nominal norms regarding oral exam for- 
mat. The most generalizable feature, at 
84%, is examiners following up on one 
another’s lines of questioning. In keeping 
with this, a high degree of exam structure 
is fairly rare (16% of responding pro- 
grams), as is limiting examiners to a set 
number of questions (12.5%). Close to 
60% offer hints to struggling examinees, 
and half ask students to review their own 
performance on earlier components (e.g., 
written exam). Examiners explicitly pre- 
pare for the oral exam on cohort and indi- 
vidual student bases in 25% and 37.5% of 
programs, respectively. Further analysis 
shows that half of responding programs 
engage either or both preparatory strate- 
gies. Only about a third of programs use 
the oral exam expressly to improve stu- 
dent mastery. Reliance on the various oral 
exam features does not vary significantly 
across degree and department types. 


Comparisons Involving the Three 
“Top-10” Lists 


Statistical comparisons revealed relatively 
few significant differences involving the 
three “top-10” program sets as distinct 
from comparable peer programs. Propor- 
tions yielding p < .10 (two-tailed) are at 
around chance levels. Significant cases 
(out of 95 variables) are identified cau- 
tiously as follows. 


The Gibby et al. (2002) “top-10” (N = 8) 
programs (all psychology doctoral) are 
(a) more likely to target areas outside of 
available courses (100% vs. 62%; 7” = 
4.32, p < .05), (b) more rigid in schedul- 
ing exams (means = 3.25 vs. 2.75, t= 
-1.67, p < .10), and (c) less generous in 
the time allowed for completing written 
take-homes (means = 4.50 vs. 18.0 days, 
t= 1.97, p < .10). 


The Kraiger and Abalos (2004) “top- 

10” (psychology) doctoral programs (N = 
5 responding to this section) (a) are 
more likely to target only available 
course material (50.0% vs. 6.1%, 7” = 
7.14, p < .01), (b) rely less on article- 
length papers (means = .0% vs. 13.2% of 
written exam grade, t = 2.30, p < .05), 
and (c) ask fewer students to retake the 
written exam (means = 5.6% vs. 15.2%, t 
= 2.29, p < .05). Finally, the Kraiger and 
Abalos “top-10” (psychology) master’s 
programs (N = 8) (a) are less flexible in 
scheduling exams (means = 4.00 vs. 


2.94, t = -3.80, p < .05), (b) have more 
faculty involved in grading oral exams 
(means = 4.33 vs. 2.40, t = -2.67, p 

< .05), and (c) ask fewer students to re- 
take the written exam (means = 2.13% 
vs. 20.29%, t = 2.70, p < .05). 


If any themes are to be identified here, 
they might be that (a) the Gibby et al. 
programs tend to be a little more rigor- 
ous in exam content and scheduling, and 
(b) the Kraiger and Abalos (2004) doc- 
toral programs tend to be less rigorous. 
The Kraiger and Abalos master’s pro- 
grams show a greater mix of differences. 
The low Ns involved in these compari- 
sons and the chance-level rates of sig- 
nificant effects preclude firm inferences 
regarding the three “top-10” lists. 


General Discussion 


A major theme evident here, paralleling 
one that emerged with internships in the 
previous installment (July, 2013), is that l- 
O programs vary markedly in how com- 
prehensive exams are prepared, adminis- 
tered, and scored. This variability is docu- 
mented overall by the relatively low per- 
centages observed on the nominal vari- 
ables in Table 1 and 5. Considering all 66 
variables and 4 (“all” plus 3) groups (= 
264 cases), the median percentage of 
responding programs endorsing a given 
feature = 40%, with third quartile = 62.5% 
(i.e., 75% of nominal variables-within- 
groups have endorsement rates < 62.5%); 
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61% of cases are less than 50%. Similarly, 
regarding the continuous variables, the 
standard deviation exceeds the corre- 
sponding mean in 40% of the 116 cases 
(29 variables x 4 groups). Such variability 
strains the concept of “norm,” and read- 
ers should be wary, accordingly, of mak- 
ing too much of central tendency indices 
(means, medians) as markers of 
“normality” in |-O graduate programs 
regarding comprehensive exams. 


The only major “universal” in the current 
installment is a partial one: 100% of doc- 
toral programs offer comps. Reflecting 
German scholastic standards from the 
early 1800s (Goodchild & Miller, 1997), 
comprehensive exams are widely recog- 
nized 200 years later as a required hurdle 
in earning a doctorate in I-O. The weaker 
reliance on comps by master’s programs 
(41% in psychology; 1 of 5 responding 
programs in business/management) is 
reflected in several significant differences 
between degree types. Specifically, mas- 
ter’s programs are (also) less likely to (a) 
include a written take-home component 
and (b) an article-length paper, (c) test on 
advanced methods and (d) material out- 
side of available courses, and (e) offer 
sample preparatory exams; they also (f) 
use proctored written and quantitative 
exams that are half as long as those used 
in doctoral programs. Collectively, all 
these differences between degree types 
(within psychology departments) are con- 
sistent with standards being higher in 
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doctoral versus master’s programs. We 
suspect the use of comps may be a grow- 
ing trend in master’s programs. Further 
study (with later surveys) might address 
this question. 


Much more could be investigated in the 
current dataset as to correlates of com- 
prehensive exam policies and procedures 
in l-O programs. We reserve such inquiries 
for later analysis and discussion involving a 
broader array of survey variables. For 
now, we hope current results help I-O 
graduate programs see how their own 
comprehensive exam protocols compare 
to those of other programs, and further 
advance discussion of evaluative stan- 
dards in l-O psychology graduate educa- 
tion more broadly. Next up in the series: 
assistantships and resources. Stay tuned. 


* Of the 7 business/management Masters programs 
completing the survey, 5 responded to the comprehen- 
sive exam section, and just 1 of those reported using 
comprehensive exams. 

? Rows for basic descriptives, correlation, and chi square 
in Table 5 here were dropped in running the correla- 
tions because they have no direct counterparts in fre- 
quencies of course offerings. 

3 This is somewhat conjectural, as the unit of analysis is 
content area, not program. Strictly speaking, content 
areas more commonly considered “fair game” tend to 
be offered more often in courses. 

4 Directional hypotheses were not advanced in this 
primarily descriptive effort. Where plausible directional 
differences might be expected (at the reader’s discre- 
tion and risk), p < .10 offers a one-tailed p < .05. 
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Abstract: Prospective graduate students in 
l-O psychology frequently use the Internet 
to research academic programs. Although 
the information that is available online is 
helpful, it may be incomplete, inaccurate, 
or outdated. The authors explored univer- 
sities’ websites to assess the availability of 
program information, and the results are 
reported here. In addition, we provide 
recommendations for program directors 
regarding ideas to consider when updating 
program websites. 


l-O Program Information Available on 
Universities’ Websites 


As TIP’s recent switch to an all-digital 
format suggests, it is common for peo- 
ple to turn to the Internet for informa- 
tion about a variety of topics. This is es- 
pecially true of prospective I-O graduate 
students who are interested in learning 
about academic programs. Two common 
sources of information include the SIOP 
website and universities’ individual web- 
sites. Although these resources are help- 
ful, they are also limited. On the SIOP 
website, for example, the most recent 
study examining program rankings was 
published in 2005 (Oliver, Blair, Gorman, 
& Woehr, 2005). Likewise, universities’ 
websites may be out of date or contain 


inconsistencies between program- 
specific and department-wide pages. In 
addition, not all universities provide the 
same types of information, which makes 
it difficult for prospective students to 
make comparisons across programs. 
Thus, the goal of this study is twofold: to 
present statistics regarding the informa- 
tion that is currently available on pro- 
grams’ websites and to provide program 
directors with recommendations for 
both the type of information they may 
wish to provide and suggestions for do- 
ing so. 


Regular TIP readers are likely aware that 
Tett and his colleagues are currently re- 
porting the results of a similar study, the 
2011 SIOP I-O Psychology Graduate Pro- 
gram Benchmarking Study (for the first 
four articles in this series, see the past four 
issues of TIP). One of the unique contribu- 
tions of the benchmarking study is that 
Tett and his colleagues surveyed directors 
of master’s and doctoral-level programs in 
psychology and allied fields such as busi- 
ness. The current study is intended to be a 
helpful corollary to the benchmarking 
study in that it provides information from 
an “outsider’s” perspective; we present 
statistics about program data that pro- 
spective graduate students can find 
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online. Although the scope of our study is 
narrower than that of the benchmarking 
study (i.e., we only gathered information 
about domestic PhD programs in I-O psy- 
chology), our results supplement those 
reported by Tett et al. (2012, 2013a, 
2013b). In addition, we provide program 
directors with recommendations for main- 
taining accurate websites. 


Method 


Inclusion Criteria 

After downloading a list of |-O programs 
from the SIOP website, we decided to 
use two criteria for determining which 
programs to include in the study. First, 
the program had to offer a PhD in I-O 
psychology. We did not collect informa- 
tion about allied programs such as hu- 
man resource management or organiza- 
tional behavior. Likewise, we did not 
collect information for terminal master’s 
or PsyD programs. We believed that 
most prospective graduate students 
who are interested in l-O PhD programs 
have already ruled out other types of 
degrees. Second, we decided that the 
programs had to be located within the 
United States. These criteria were cho- 
sen to help limit the scope of the project 
and to enable comparisons across pro- 
grams. It is worth noting that one uni- 
versity had programs in two locations; 
data were collected for both programs. 
Based on these criteria, 49 universities 
were included in the study. For many of 
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the variables for which data were re- 
corded, however, information was not 
available for all 49 universities. The Ns 
for each variable are reported through- 
out the study. 


Content Areas 

We collected data on topics that are of 
interest to potential graduate students. 
Program administration, for example, in- 
cludes information about academic calen- 
dars, program formats (i.e., traditional 
onsite, hybrid, or online), and whether 
people can enroll as part- or full-time stu- 
dents. Regarding application require- 
ments, we gathered information about 
GRE scores, GPAs, and the documents and 
fees that prospective students are asked 
to submit. Information about applicant 
and student demographics includes data 
about application, acceptance, and enroll- 
ment rates. Curriculum data focuses on 
the number of required and elective 
courses. The major assessments category 
includes information about comprehen- 
sive or qualifying exams, theses, and dis- 
sertations. We also gathered information 
about student funding opportunities and 
faculty productivity. Specific examples of 
these major categories can be found in 
Table 1. 


Data Collection 

We collected data between June and Au- 
gust 2012 by visiting the websites of pro- 
grams that met the inclusion criteria. If 
program handbooks or other applicable 


Table 1 


Major Content Areas and Examples 
Program Administration 
Academic calendar (i.e., quarter or semester) 
Enrollment status (i.e., full time or part time) 
Instructional method (i.e., traditional, hybrid, or on-line) 
Application Requirements 
GPA and GRE scores 
Documents (e.g., letters of recommendation, transcripts) 
Applicant and Student Demographics 
Number of annual applicants 
Acceptance and enrollment rates 
Cohort gender and diversity 
Post-graduation placement 
Curriculum 
Number of required courses 
Number of required credits 
Availability of minors or concentrations 
Major Assessments 
Comprehensive/Qualifying exams 
Thesis 
Dissertation 
Funding 
Stipends 
Assistantships 
Faculty Productivity 
Number of full-time, tenure-track faculty 
Number of faculty, not full-time or tenure-track 
Number of journal publications, last five years 
Number of journal publications, lifetime 
Number of journal publications, lifetime in top-5 journals 


references were linked to programs’ 
websites, they were also used as 
sources of data because prospective 
students would be able to access these 


references. We deviated from this proc- 


ess when gathering information about 


faculty productivity. Rather than finding 


information on I-O programs’ websites, 
we used PsycINFO. This decision was 


made for two reasons. First, it was diffi- 


cult to find faculty members’ current 


CVs on-line. In addition, using data from 


PsycINFO allowed us to update the re- 
search productivity data first published 


by Oliver et al. (2005). When calculating 


statistics regarding publications in the 
top five journals, we used Academy of 


Management Journal, Academy of Man- 


agement Review, Journal of Applied Psy- 
chology, Organizational Behavior and 
Human Decision Processes, and Person- 
nel Psychology, which is consistent with 
the journals used in extant studies of 
program rankings (Gibby, Reeve, Grauer, 
Mohr, & Zickar, 2002; Winter, Healy, & 
Svyantek, 1995). An advantage of our 
method is that it permits comparisons 
between our results and those of prior 
studies. A disadvantage is that it does 
not include JOP, which has become an 
important publication outlet since those 
earlier studies. 


Readers might notice that interrater 
agreement statistics are not reported for 
any of the data in this study. Most of the 
variables that are included in this research 
required that information be recorded 
rather than interpreted. For example, a 
website might state that internships are 
required, or that they are not, or it may be 
silent on this issue. There are a few excep- 
tions to this that will be discussed later. 
Another limitation of the data collection 
process was that there were instances, as 
will be discussed below, in which it was 
difficult to determine whether the infor- 
mation provided on universities’ websites 
was specific to l-O programs or if it was 
aggregated across multiple graduate pro- 
grams within psychology departments. 
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Results 


Program Administration 

This category includes information 
about academic calendars, enrollment 
status (i.e., full time or part time), and 
instructional methods (i.e., traditional 
onsite, hybrid, or online). We were able 
to find information on academic calen- 
dars for 44 (89.80%) universities. Most l- 
O programs (90.90%) were on a semes- 
ter system, and most of the remaining 
universities were on a quarter system. 
Information about enrollment status 
was available for 43 (87.80%) universi- 
ties. A majority of these universities 
(90.70%) only admitted full-time stu- 
dents. Data on instructional methods 
were available for 41 (83.70%) universi- 


Table 2 
Application Requirements 
Percent of 
universities Percent of 
thatreport universities 
Variable data thatrequire Mi 

GRE (Verbal) 89.80 100.00 
GRE (Quantitative) 89.80 100.00 
GRE (Composite) 91.84 100.00 
GRE (Psychology) 30.61 20.00 
GPA (Composite) 87.76 100.00 
GPA (Junior/Senior) 12.24 83.33 
GPA (Psychology) 6.12 83.33 
Application fee 53.06 100.00 
Personal statement 83.67 100.00 
Transcripts 93.88 100.00 
Letters of reference 93.88 97.83 
Writing sample 24.49 41.67 
College application 81.63 100.00 
Department 30.61 80.00 


ties; most of them (90.24%) were tradi- 
tional on-site programs. Traditional on- 
site universities may, however, offer 
hybrid or online courses as part of their 
curricula. 


Application Requirements 

Information about application require- 
ments such as GRE scores, GPA require- 
ments, personal statements, and letters 
of recommendation can be found in Ta- 
ble 2. Although information regarding 
these requirements was available for a 
majority of universities, there was some 
variability in the data. Nearly 90% of uni- 
versities provided information about 
desired, average, or minimum verbal, 
quantitative, and composite GRE scores 
and undergraduate GPA requirements. 


Percent of Percent of 
universities that 


report minimum report mean 


nimum scores M scores 
516.67 16.32 587.93 42.22 
533.33 16.32 679.33 38.78 
1066.67 14.29 1243.27 34.69 
- 0.00 678.67 8.16 
3.04 32.65 3.59 48.98 
3.23 10.20 3.55 6.12 
3.13 4.08 3.79 2.04 
- - 54.00 40.82 


Note. The percent of universities that require is calculated using the number of universities for which data were 


available. Some universities listed minimum and avera 
scores; one university listed scores for the revised GRE. 


ge GRE requirements as percentages rather than raw 
These were excluded from the minimum and average 


calculations. For many universities, it was unclear whether the data were specific to |-O programs or were 


aggregated across all psychology programs. 
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universities that 


Less than one-third of the universities 
included in the study provided informa- 
tion about their GRE psychology subject 
test and upper-class and psychology 
GPA requirements. Interestingly, ap- 
proximately one-half (53.06%) of univer- 
sities reported whether they require 
application fees. A majority of universi- 
ties reported whether they require per- 
sonal statements, transcripts, and let- 
ters of recommendation (83.67%— 
93.88%). 


It is interesting to note that there are 
similarities among the data reported by 
Tett et al. (2013a) and the data reported 
here. Both studies report similar statis- 
tics regarding the percent of universities 
that require transcripts (100% in both 
studies), letters of recommendation 
(100% reported by Tett et al. versus 
97.83% reported here), personal state- 
ments (88.1% versus 100%), and GRE 
general/subject test scores (92.9% ver- 
sus 100%; 9.5% versus 20%). Likewise, 
we both report similar cutoffs, including 
mean undergraduate GPAs (3.27 re- 
ported by Tett et al. versus 3.59 re- 
ported here), GRE verbal scores (554.20 
versus 587.93), GRE quantitative scores 
(579.20 versus 679.33), and GRE com- 
posite scores (1146.40 versus 1243.27). 
The differences between the data might 
be a result of the fact that Tett et al. in- 
cluded PsyD programs in their sample. 


We encountered a few issues when col- 
lecting these data. The first was the 
change in GRE scoring practices. During 
data collection, we only found one uni- 
versity that reported minimally accept- 
able and average GRE scores using the 
scale that went into effect in 2011. Asa 
result, the scores reported here and on 
most programs’ websites will likely be of 
limited use in the future. Second, it was 
difficult to determine whether the mini- 
mally acceptable and average GRE 
scores and GPA requirements were I-O 
specific or aggregated across psychology 
programs. Finally, some application ma- 
terials were required by only one or two 
universities. Descriptive statistics for 
these materials, which included research 
interest forms and course histories, 
were not calculated. 


Application and Acceptance Rates 

The statistics for application and accep- 
tance rates are reported in Table 3. 
Given prospective students’ interest in 
topics such as average cohort size and 
postgraduation placement information, 
we were surprised that these types of 
data were available for approximately 
one-third of the universities included in 
the study. Although means were calcu- 
lated for the annual number of appli- 
cants and acceptances, high standard 
deviations indicate the variability of 
these statistics. Further evidence for 
variability can be found in the fact that 
Tett et al. (2013a) reported the mean 
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number of applicants per year as being 
67.1, whereas we report a mean of 
93.53. Likewise, the data regarding the 
percent of applicants who actually enroll 
in programs is unreliable, given the small 
percentage of universities for which this 
information was available. As was true 
for the information about application 
requirements, in some instances it was 
difficult to tell whether the information 
that universities provided on their web- 
sites was program specific or aggregated 
across psychology programs. 


Table 3 
Application and Acceptance Rates 


Curriculum 

The data regarding universities’ l-O curric- 
ula are reported in Table 4. Interestingly, 
this information was available for less than 
three-fourths of the universities included 
in the study. In addition, less than one- 
quarter of the included universities re- 
ported whether minors, concentrations, or 
other forms of subspecialization were 
available to students. About 60% of the 
universities provided information about 
the required number of | and O courses, 
whereas a little over 70% of the universi- 
ties reported information about the num- 
ber of required statistics and methods 
courses. Course information was deter- 


Percent of universities that report 


Variable data M SD 

Number of applicants annually 34.69 93.53 30.68 
Percent of applicants accepted 34.69 7.14 3.63 
Percent of applicants who enroll 8.16 4.65 0.94 
Average cohort size 20.41 4.75 0.79 
Percent of applicants with previous graduate work 8.16 18.50 7.68 
Postgraduation placement information 32.65 - - 
Percent of graduates who pursue academic 
placements 28.57 26.70 14.27 
Note. For many universities, it was unclear whether the data were specific to l-O programs or were aggregated across all psychology 
programs. 

Table 4 

Curriculum 

Percent of universities Percent of universities 
Variable that report data M SD that allow 

Number of required | courses 57.14 3.42 1.39 - 

Number of required O courses 57.14 2.62 1.36 - 

Number of required statistics/methods 

courses 71.42 4.00 0.87 - 

Number of required core credit hours 36.73 70.61 24.44 - 

Number of required credit hours 71.42 91.37 19.56 - 


Availability of minors 
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24.49 


mined by reviewing course listings and 
assigning each course to an |, anO, ora 
statistics category. Examples of classes 
assigned to the I category include selec- 
tion, performance appraisal, and training, 
whereas examples of classes assigned to 
the O category include organizational the- 
ory, motivation, and consultation. All the 


course coding was done by the first author. 


A difficulty we faced when gathering the 
information for this category was the 
wide variety of course names and de- 
scriptions we encountered. In addition, 
program requirements were not always 
provided in a straightforward manner. 
More than once, this information was 
buried within programs’ websites or in 
linked pdfs of program handbooks. This 
suggests that prospective students may 


have a difficult time finding this informa- 


tion, which may hinder their ability to 
make accurate comparisons among the 
programs in which they are interested. 


Another difficulty was the number of 
programs that combine topics, some- 
times both I and O topics, within a single 
course. A typical course name might be 
“Seminar in l-O Psychology”; it is possi- 
ble that students would take such a 
course more than once, presumably 
with different sets of topics included. 


Major Assessments 

Information about major assessments, 
such as theses, comprehensive or quali- 
fying exams, and dissertations, is avail- 
able in Table 5. A majority of universi- 
ties, between 73% and 82%. provided 
information about whether a thesis and 
a dissertation are required. A little more 


Table 5 
Major Assessments 
Percent of universities that report Percent of universities that 
Variable data require 

Thesis required 73.47 94.44 

Comprehensive/qualifying exams 

required 75:51 100.00 

Comprehensive/ qualifying exams 

format 51.02 - 
Written - 40.00 
Oral - 4.00 
Written and oral - 36.00 
Alternative format - 20.00 

Comprehensive/qualifying exams 51.02 - 
Proctored - 60.00 
Take-home - 12.00 
Proctored and take-home - 4.00 
No written - 24.00 

Dissertation required 81.63 100.00 
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than half of the universities included in comprehensive exam, some universities 
the study provided information about reported using alternative assessments, 
comprehensive or qualifying exams. In- including a written comprehensive re- 
terestingly, there is little consensus re- view paper or submitting manuscripts 
garding the format of this assessment. for publication, as a way of evaluating 
The available information suggests that students’ mastery of the curriculum. 

a written exam or a combination of a 

written and an oral exam is most preva- Student Funding 

lent and that the written componentis The statistics regarding student funding 
more likely proctored than not. In addi- are provided in Table 6. Information 


tion to the traditional written or oral about tuition waivers and stipends was 
Table 6 
Student Funding 
Percent of 
universities Percent of 
that report universities 
Variable data that provide M SD 
Tuition waiver 75.51 - - 
Full - 48.65 - - 
Partial - 16.22 - - 
Waiver given, amount unkn - 27.03 - - 
Stipend provided 79.59 92.31 - - 
Stipend amount 40.82 - 13,573.59° 1999.43 
Years stipend provided 36.73 - 4.00 2.83 
Assistantships 85.71 97.62 - - 


Additional provided funding 
(grants, scholarships, 


fellowships) 42.86 90.48 - - 
Availability of summer funding 22.45 54.56 - - 
Health insurance provided 26.53 46.15 - - 
Health insurance funding 

provided 26.53 76.92” A : 


Note. “Three universities provided these data per month or per assistantship hours worked; these were 
excluded when calculating the mean and the standard deviation. ° The number of universities that provided 
information about the amount of insurance funding was too small (N =2)to calculate a meaningful mean and 
standard deviation. For many universities, it was unclear whether the data were specific to l-O programs or 
were aggregated across all psychology programs. 
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available for approximately 75% of the 
universities included in the study. Data 
regarding the amount of the stipend, the 
number of years it is available, and 
whether additional or summer funding is 
available was found for less than half the 
included universities. In addition, only 
about one-quarter of the universities indi- 
cated whether health insurance or fund- 
ing for health insurance was provided. 


As has been mentioned, in some cases it 
was difficult to determine whether the 
information provided on websites was 
specific to l-O programs or whether the 
data were aggregated across all psychol- 
ogy programs. When interpreting the 
mean stipend, it is important to also 
consider the relatively high standard 
deviation. 


Faculty Information 

The data regarding faculty productivity 
can be found in Table 7. Over 95% of the 
universities included in the study pro- 
vided information about the number of 
full-time, tenure-track faculty. The mean 
number of core faculty reported here 
(5.02) is slightly higher than the number 
reported by Tett et al. (4.7; 2012). As was 
mentioned earlier, the statistics regard- 
ing faculty publications were calculated 
using information that was available on 
PsycINFO. It is worth noting that the stan- 
dard deviation for the number of lifetime 
publications in the top five journals ex- 
ceeds the mean statistic. 


Table 7 
Faculty Productivity 


Percent of 

universities 

that report 
Variable data M SD 
Faculty, full- 
time, tenure- 
track 95.92 5.02 1.61 
Faculty, other® 63.27 4.00 3.35 
Publications, 
last 5 years” - 6.11 3.76 
Publications, 
lifetime? 21.87 14.10 
Publications, 
lifetime in top- 
5 journals” : 4.77 483 


Note. °Examples include emeriti, associated, affiliated, 
and adjunct faculty. ° These statistics are calculated 
using the number of full-time, tenure-track faculty. 


Discussion 


Recommendations 

As the statistics suggest, there is vari- 
ability regarding the amount of informa- 
tion that prospective I-O graduate stu- 
dent can find on programs’ websites. This 
is potentially problematic, given the cur- 
rent cultural shift in which the Internet is 
increasingly becoming an important 
source of information. From a marketing 
perspective, prospective students may be 
less likely to apply to l-O PhD programs 
for which little information is available. In 
addition, once students have been ac- 
cepted into a program, often more than 
one, a lack of information complicates 
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their ability to make accurate across- 
program comparisons that might help 
them choose which offer to accept. Pro- 
viding program information may also in- 
crease the number of high-quality appli- 
cants and reduce the number of requests 
for information that program faculty re- 
ceive throughout the year. We provide 
some recommendations to help address 
these issues. 


Update websites. Our first recommenda- 
tion is that program directors establish a 
specific annual or biennial schedule for 
updating their programs’ websites. The 
near-universal reporting of older GRE 
scores is an example of outdated infor- 
mation that should be addressed. When 
updating websites, it would also be 
beneficial to check links to make sure 
they are active. When looking at sites, 
we tested all the links we encountered 
and many led to error messages or 
seemingly unintended destinations. Cur- 
rent students can often navigate around 
dead links but this is much more difficult 
for potential applicants. Likewise, it may 
be beneficial to establish a chart or a 
checklist to ensure that information lo- 
cated in multiple places is updated at 
the same time. In addition, it would be 
helpful to indicate what information 
provided on websites is l-O specific. This 
is especially true of application require- 
ments, which may vary by program 
within a department (e.g., I-O vs. Clinical 
vs. Social). Finally, it may be helpful to 
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provide information about when web- 
sites were last updated. 


Consistent formatting. Program direc- 
tors can work with their colleagues from 
other universities to establish guidelines 
for providing information consistently. 
One possibility is to add or develop fre- 
quently asked questions (FAQ) pages. 
Other possibilities include either using 
the template that Tett et al. provided 
when they gathered data for the bench- 
marking study or using the same format 
that is used on the SIOP website. A final 
possibility would be to voluntarily adopt 
APA Implementing Regulation (IR) C-20, 
which is a document that requires APA- 
accredited clinical doctoral programs to 
provide information about students’ 
time to program completion, attrition 
rates, and program costs (APA, n.d.). 
Although I-O programs are not accred- 
ited by the APA, the templates provide 
by IR C-20 could easily be adapted for 
use by I-O programs. While not all uni- 
versities may be able to provide infor- 
mation by using the same template, at 
the very least it would be helpful for 
them to provide the same types of infor- 
mation in a way that is easily accessible 
to prospective graduate students. 


Course descriptions. Prospective stu- 
dents apply to programs with myriad 
end goals in mind. Programs may wish 
to consider providing prospective stu- 
dents with more detailed information 


about course offerings and require- 
ments. Theoretically this could be done 
by providing a direct link to universities’ 
course management software programs. 
If universities choose to do so, however, 
they should make sure that the program 
allows for guest access. An alternative 
solution would be to upload to their 
websites a pdf, or some other docu- 
ment, that lists course names, descrip- 
tions, and requirements. 


GRE scores. As was noted previously, a 
majority of universities included in the 
study reported GRE scores using the pre- 
2011 scale. We recommend that univer- 
sities begin reporting minimum and av- 
erage GRE scores using the scale that 
went into effect in 2011. 


Additional information. There were in- 
stances in which we were surprised by 
the lack of information that was avail- 
able on programs’ websites. This was 
true for the variables reported here as 
well as for variables that we initially 
planned to include but later excluded 
because of insufficient information. 
Therefore, program directors may want 
to review their programs’ websites to 
make sure that the sites include infor- 
mation that prospective students would 
find helpful. This could also include in- 
formation about the larger community, 
as many students do not attend pro- 
grams in their hometown. 


Limitations and Future Directions 


We encountered a few unexpected issues 
when collecting data. For example, in 
some instances it was difficult to deter- 
mine whether the information provided 
by universities was specific to l-O pro- 
grams or aggregated across psychology 
programs. In addition, the available infor- 
mation for some topics (e.g., the number 
of applicants with undergraduate de- 
grees in psychology, the percentage of 
male and female students, the type of 
degree that students receive after com- 
pleting their thesis) was so sparse that 
we were unable to provide meaningful 
summary statistics. A limitation of the 
process is that websites essentially con- 
stitute “self-report” data, which may be 
inaccurate for a variety of reasons. Uni- 
versities could have updated their web- 
sites after the data collection process was 
complete, for example. 


The recent work by Tett et al. (2012, 
2013a, 2013b) suggests that there is an 
ongoing interest in universities’ program 
information. We agree. In the future 
researchers could explore allied and ter- 
minal master’s programs using the 
methodology employed in this study. In 
addition, researchers might further com- 
pare the results reported here with 
those reported by Tett et al. (2012, 
2013a, 2013b). Significant discrepancies 
may suggest that the information uni- 
versities provide on their websites is 
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inaccurate, which could be problematic 
in terms of program marketing. 
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An Introduction to Portland State 
University: “Let Knowledge Serve the City” 


Welcome to Portland State University’s TIP-TOPics col- 
umn! We are honored and excited to begin the next 
phase of this column for The Industrial—Organizational 
Psychologist. We’ve been inspired by the amazing work 
of the University of Akron team over the past 2 years 
and are thankful for the opportunity to share our per- 
spective with you! We also look forward to learning 
from our readers and hope that this column will serve 
to spark conversation and help us develop relationships 
with students and faculty from other programs. Thanks 
to the diverse focus of our program at Portland State, 
we believe that we will able to bring a fresh perspective 
on the graduate school endeavor. This being said, we 
would like to begin our first column with a brief over- 
view of our program. This includes an explanation of 
our program’s history and structure, a description of 
our Occupational Health Psychology program, and an 
introduction to our faculty and students. We finish with 
a little insider information on what it’s like to live in 
Portland (a truly unique place) and what you can expect 
from our columns to come. 


Portland State University’s (PSU) Industrial-Organizational 
Psychology Program is a PhD program located in the heart 
of Portland, Oregon, with a distinct dedication to our uni- 
versity’s motto, “Let Knowledge Serve the City.” Our fac- 
ulty and students have a passion for serving our local, re- 
gional, national, and international communities. Some of 
our most meaningful work relates to our contributions to 
SIOP, the Society for Occupational Health Psychology 
(SOHP), the European Association of Work and Organiza- 
tional Psychology (EAWOP), and the Portland Industrial & 
Organizational Psychology Association (PIOPA). We know 
that our work on TIP-TOPics will be likewise fulfilling and 
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challenge us to reflect on our identity as a 
program as we share our thoughts and 
ideas with you. 


Structure of the Program 


The first PhD in Applied Psychology with 
a focus in I-O at PSU was awarded in 
1999. Prior to 1999, our program coex- 
isted within the Systems Science Depart- 
ment here at PSU. Our psychology pro- 
gram is applied in nature, with the goal 
of advancing knowledge through a scien- 
tific approach to human behavior and 
addressing significant issues facing em- 
ployees. We recognize the need for in- 
terplay between experimental and natu- 
ralistic methods in analyzing problems 
and testing solutions to real world prob- 
lems. Nearly all of our research is con- 
ducted with community-partner organi- 
zations rather than in the lab. Require- 
ments of our doctoral program include 
successfully completing coursework 
(including a rigorous multicourse statis- 
tics series), conducting and defending a 
master’s thesis, passing comprehensive 
exams, completing an internship, and 
conducting and defending a doctoral 
dissertation. 


Occupational Health Psychology Program 


Many of our I-O students minor in occu- 
pational health psychology and are pas- 
sionate about conducting research that 

helps improve the health and well-being 


of employees and organizations. Our 
department hosts an occupational 
health psychology training program 
(http://www.ohp.psy.pdx.edu/) that has 
been funded since 2004 through a 
NIOSH Training Program Grant. Our OHP 
program includes a survey course and a 
variety of specialized OHP elective 
courses. In addition to offering graduate 
student training in OHP, our training 
program collaborates with Oregon 
Health & Science University’s (OHSU) 
Center for Research on Occupational 
and Environmental Toxicology (CROET), 
the Center for Health Research (CHR), 
and the University of Oregon’s Labor 
Education Research Center (LERC) as a 
part of the Oregon Healthy Workforce 
Center (OHWC), a NIOSH Center of Ex- 
cellence. 


OHP Summer Institute 


Last year, Portland State hosted the first 
annual Occupational Health Psychology 
Summer Institute, which was a collabo- 
rative effort between PSU’s OHP pro- 
gram, OHSU, CROET, the Oregon Healthy 
Workforce Center (ORhwc), and Saint 
Mary’s University’s Center for Occupa- 
tional Health and Safety. The Summer 
Institute provided an opportunity for 
faculty, graduate students, and applied 
researchers in OHP, occupational safety, 
human resources, and related fields to 
learn about current and future issues in 
OHP and network with other profession- 
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als from around the world who are com- 
mitted to improving employee well- 
being. Speakers included Dr. Joseph Hur- 
rell, who played a crucial role in the de- 
velopment of the field of OHP, and Dr. 
Dov Zohar, a leading safety climate re- 
searcher. This July, the second annual 
OHP Summer Institute was held at Saint 
Mary’s University in Halifax, Nova Scotia. 


Internship Program 


The goal of the internship program at 
PSU is to conduct scientific research and 
contribute to applied projects, offering 
innovative and practical solutions to the 
field. Our internships generally involve a 
field placement or off-campus research 
experience. Although each internship 
assignment is related to the student’s 
professional interests, placements 
should also expand understanding or 
introduce new areas of study. Students 
typically complete internships between 
their third and fourth year of the gradu- 
ate program, with many taking intern- 
ships after completing comprehensive 
exams yet before beginning work on the 
dissertation. Internships last a minimum 
of 3 months, though we have had sev- 
eral students who take longer intern- 
ships ranging from 6 to 9 months. We 
value the opportunity to gain hands-on 
experience during our graduate school 
career and are fortunate enough to 
work with acclaimed researchers and 
practitioners from all over the country. 


The Industrial Organizational Psychologist 


In recent years, our graduate students 
have held internships in organizations 
such as Google, HumRRO, Liberty Mu- 
tual Research Institute for Safety, Logi- 
tech, the Oregon Museum for Science 
and Industry (OMSI), Sentis, and Suc- 
cessFactors. 


Faculty and Graduate Students 


Our program has five I-O faculty mem- 
bers: Drs. Charlotte Fritz, Leslie Ham- 
mer, Keith James, Donald Truxillo, and 
Liu-Qin Yang. Their research represents 
a wide range of topics, including recov- 
ery from work, the work-life interface, 
the aging workforce, person— 
environment fit, creativity, and leader- 
ship. Our faculty members also serve in 
a number of capacities outside of their 
formal roles within the department. For 
example, Dr. Donald Truxillo has served 
SIOP in a number of important capaci- 
ties over the years, including as a past 
Program Chair and Conference Chair of 
the SIOP conference, as well as serving 
as the chair of SIOP’s International Af- 
fairs Committee. Dr. Liu-Qin Yang has 
coauthored a series of columns with 
Ashley Walvoord for The Industrial- 
Organizational Psychologist entitled 
“Yes You Can: /-Os and Funded Re- 
search.” In addition to our five core l-O 
faculty members, our department col- 
laborates regularly with several faculty 
members from PSU’s School of Business 
Administration. These faculty members 


include Drs. Talya Bauer and Berrin Er- 
dogan, who conduct research on a num- 
ber of |-O-related topics, including rela- 
tionships at work, leader—member ex- 
change, and overqualification. We are 
proud to say that four of our faculty 
members—Talya Bauer, Berrin Erdogan, 
Leslie Hammer, and Donald Truxillo— 
have been named SIOP Fellows. Our fac- 
ulty and graduate students regularly en- 
gage in cross-department collabora- 
tions, to the benefit of all involved. Ina 
coming column, we will discuss several 
ongoing research projects within our 
department to expand on our experi- 
ences of working with a variety of com- 
munity partners. 


Our I-O program currently consists of 19 
graduate students, 10 of whom make up 
the team of TIP-TOPics writers who will 
be contributing to the column over the 
coming 2 years. Our program is organ- 
ized such that each graduate student 
works under the supervision of a specific 
faculty advisor, with each faculty mem- 
ber taking responsibility for several 
graduate students, forming the basis of 
our research labs. These relationships 
serve to ensure graduate students re- 
ceive guidance and support throughout 
their graduate school careers. However, 
students often branch out during their 
time in the program to collaborate and 
publish with other faculty members, a 
practice that is highly encouraged in our 
tight-knit department. 


Doctoral students in I-O, as well as those 
in Applied Social & Community Psychol- 
ogy and Applied Developmental Psychol- 
ogy (the two other areas that comprise 
our Psychology Department here at 
PSU), take an active role in helping to 
shape the graduate program and pursue 
civic and social engagement through the 
Psychology Graduate Student Associa- 
tion (PGSA). The group meets regularly 
to plan and execute professional devel- 
opment events, communicate with fac- 
ulty about continuing to grow and im- 
prove the program, and schedule charity 
and social events. In recent years, PGSA 
has also organized prospective student 
recruitment events and developed a 
mentoring program for first-year gradu- 
ate students. Examples of activities ar- 
ranged by PGSA include organizing pro- 
fessional development panels focused 
on topics such as finding an internship, 
successfully passing comprehensive ex- 
ams, and publishing peer-reviewed pub- 
lications as a graduate student; food and 
toy drives for Portlanders in need; 5k 
charity walks supporting mental health 
awareness; and last but not least, plan- 
ning happy hours and get-togethers. 
One of our planned columns will focus 
on our graduate students’ service to the 
department. Our hope is that other stu- 
dents, faculty members, and administra- 
tors might find such examples useful 
while developing similar programs in 
their own departments. 


October 2013 Volume 51 Issue 2 


Portlandia 


We would be remiss to discuss our pro- 
gram without mentioning Portland itself. 
For those of you who have watched the 
show Portlandia or heard of the various 
Portland stereotypes, we’re here to tell 
you that they’re mostly true—but in the 
most amazing and endearing way. It’s 
not inaccurate to say that our city is full 
of people who think that not recycling is 
as serious a crime as aggravated assault. 
And most people are concerned about 
whether or not the chicken they’ re eat- 
ing for dinner had a happy life. But that’s 
what makes Portland awesome—we live 
in a city of unique characters, people 
who really care about the place they 
live. In addition, there are endless op- 
portunities to do really fun activities 
outdoors: hang out on the beautiful Ore- 
gon coast, hike in the Columbia Gorge, 
go tubing/kayaking/ rafting in the sum- 
mer, and ski/snowboard/snowshoe in 
the winter. Oh, and did we mention we 
have some of the best food and beer in 
the world? (How do you think we get 
through grad school?) 


Overview of the Upcoming/ 
Future Columns 


Given our program’s focus on research, 
applied work, and service in the local, 
national, and international communities, 
our group of students is excited to con- 
tribute commentary pieces for TIP- 
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TOPics. We first plan to offer helpful 
columns on several important steps in 
the graduate school process that are 
applicable to new and returning stu- 
dents alike. These include pieces high- 
lighting practical tips and tricks for mak- 
ing the most of grad school, recommen- 
dations for grad students interested in 
bolstering their programs’ internal 
strengths and infrastructure with stu- 
dent-led workshops, mentoring pro- 
grams, and service work, in addition to 
columns dedicated to providing advice 
on building a CV with teaching and pub- 
lishing experience. A how-to column will 
also be devoted to attaining a career ina 
specialty field, like OHP. In addition to 
these student-focused columns, we plan 
to discuss how our program has gained 
visibility through local and broader col- 
laborations, thereby providing other 
programs with examples for working 
within their communities. Our last col- 
umn will take a broader focus and dis- 
cuss prosocial l-O more generally, spe- 
cifically as it is an ongoing interest of 
SIOP. We hope by giving you a window 
into our program here at PSU we can 
not only inform you of our background 
and approach to the coming columns 
but also start a dialogue surrounding 
different approaches to the graduate 
school experience. As we embark on this 
new endeavor, we look forward to 
learning about the exciting and unique 
features of your program, as well! We 
would like to continue the University of 


Akron’s practice of soliciting feedback 
from TIP-TOPics readers on column top- 
ics and content, as we feel such a dia- 
logue contributes to a column that is 
ultimately more useful to our readers. 
Thus, at the end of each column, we will 
include a brief description of the upcom- 
ing article and an open call for corre- 
spondence including suggestions, ideas, 
and so on. As such, we offer a brief syn- 
opsis of the next column below. 


Our Upcoming Column 


Building on The University of Akron’s 
final column on “The Top Ten Things We 
Wished We Knew Before Graduate 
School,” our group of columnists will 
share advice with new graduate stu- 
dents on how to successfully make the 
most of one’s graduate school career. 
These practical tips and tricks come 
from a number of our own experiences 
in graduate school and include becom- 
ing involved in faculty research, making 
the transition from undergraduate to 
graduate school, finding study strategies 
that work best for you, how to get in- 
volved in additional service inside and 
outside of the department, networking 
and socializing with other graduate stu- 
dents, reducing stress, and learning to 
cope with the unexpected challenges or 
setbacks of graduate school. In writing 
this column, we will draw from materials 
gathered by our I-O program’s student 
socialization committee, which consists 


of senior graduate students and faculty 
advisors and is designed to socialize new 
l-O graduate students. 


To correspond with the authors about 
this topic, please e-mail portland- 


statetiptopics@pdx.edu. In addition, to 
learn more about the graduate students 
at PSU as well as the writers of our col- 
umn, you may view our graduate stu- 


dent website at http://www.pdx.edu/ 
psy/graduate-students. We look forward 


to contributing to the TIP-TOPics column 
over the next 2 years, and are excited to 
create an ongoing dialogue among TI/P’s 

readers! 


Jenn Rineer is a doctoral student in I-O Psy- 
chology at Portland State University with a 
minor in Occupational Health Psychology. 
Jenn is originally from New Jersey and 
graduated from the University of Pennsyl- 
vania with a BS in Psychology in 2007. Before 
graduate school, she was a Public Relations 
and Outreach Manager for a nonprofit fel- 
lowship program in Philadelphia. Her re- 
search interests include health and well- 
being, job design, safety, and aging. Jenn’s 
hobbies include dancing, camping and hik- 
ing, and exploring Portland’s amazing res- 
taurant/bar scene. 


Caitlin A. Demsky is a doctoral student work- 
ing under the supervision of Dr. Charlotte 
Fritz. Caitlin graduated from Central Michi- 
gan University with her BS in English and 
Psychology in 2010 and completed her MS in 
Applied Psychology from Portland State Uni- 
versity in 2012. Her research centers on re- 
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covery from work, work-life balance, and 
workplace aggression. She is currently com- 
pleting her PhD in I-O Psychology with a mi- 
nor in Occupational Health Psychology. Cait- 
lin’s other interests include running, hiking, 
and experiencing Portland’s food and music 
scenes. 


Tori L. Crain is currently working towards her 
PhD in Industrial-Organizational Psychology 


with a minor in Occupational Health Psychol- 
ogy from Portland State University. In 2009, 
Tori graduated with her BA in Psychology 
from Whitworth University in Spokane, WA. 
Her research interests include the interplay 
between work, family, and sleep, in addition 
to the role of family-specific social support in 
the workplace. In Tori’s free time, she loves 
to be with family and friends, playing soccer 
or exploring Portland’s hiking trails. 


SIOP has received over 1,500 submissions for the 
2014 Annual Conference. This is a positive sign for the 
conference but it means we need more reviewers! 


Quite simply, we need your help. 
Please sign up today as a reviewer to play a 
critical role in the success of the conference. 


To volunteer, click HERE! 


ui 


The Industrial Organizational Psychologist 


= m~e 
hu | 
A R 
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Can 


l-Os and Funded 
Research 


Kristen Shockley 
Baruch College, CUNY 


Ashley Walvoord 
Verizon Wireless 


Calling All Grad Students 


What graduate student wouldn’t want more flexibility 
and more resources to pursue the research that is in- 
teresting to them? Inspired by the start of another 
academic year, we dedicate this issue to the popula- 
tion of l-O grad students, both rookie and 
“orofessional students.” Even at this early juncture in 
your career, you can land some serious cash to take 
your research and education to the next level! That’s 
right, research funding is not just for the well- 
seasoned, famous, and well-established I-O psychs! 


There are many graduate student grant opportunities, 
and this quarter we’re giving you a peek at how three 
of your peers found success! Ryan Johnson, a student 
at the University of South Florida, discusses two grants 
he has received, one through a university-affiliated 
research center and the other through our very own 
SIOP. Justina Oliveira of Baruch College and The 
Graduate Center at the City University of New York 
explains how she received funding through the univer- 
sity. Rachael Klein from the University of Minnesota 
touches on her experiences successfully obtaining a 
fellowship through a national agency, the National Sci- 
ence Foundation. 


Colleagues, give us a “big picture” overview of your 
funding experience in grad school. 

Rachael: | received a Graduate Research Fellowship 
through the National Science Foundation Graduate 
Research Fellowship Program (GRFP). The fellowship 
offers graduate students 3 years of support including 
an annual stipend and an educational allowance that 
covers tuition and fees. The award allowed me to en- 
gage in academic coursework, research, and related 
activities while freeing me from teaching obligations. 
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Ryan: The first source of funding | re- 
ceived was through the Sunshine Edu- 
cation and Research Center, which is 
affiliated with the University of South 
Florida. The center itself is funded 
through the National Institute for Occu- 
pational Safety and Health (NIOSH), 
and the goal is to promote graduate 
training and research related to occu- 
pational health and safety. The center 
offers a pilot grant program each year, 
which is intended to act as seed money 
for preliminary studies to later support 
larger grants. The grants are not only 
open to USF faculty and students but 
also to other institutions and groups in 
Florida. My grant totaled about 
$11,000, and | used the money to con- 
duct my dissertation study. | also re- 
ceived the Lee Hakel Graduate Student 
Scholarship from SIOP. This award aims 
to both recognize past achievements of 
graduate students and support their 
future research projects. [Check it out 
here. ] The $3500 award was also used 
to support my dissertation. 

Justina: | received funding through the 
American Studies Archival Research 
Grant Program, which is hosted by the 
City University of New York’s Advanced 
Research Collaborative. This institute 
was developed to promote interdiscipli- 
nary research on critical contemporary 
issues. The specific grant | received pro- 
vides summer support ($4,000) for doc- 
toral students whose projects necessi- 
tate work with archival data. 
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And how did you find out about these 
opportunities? 

Rachael: | found the program online 
while researching other funding oppor- 
tunities and also received an email 
from my university’s psychology de- 
partment. The GRFP is open to first and 
second year students who meet the 
other program guidelines. 

Ryan: | was aware of the SIOP award 
through various communications 
through the SIOP website and newslet- 
ters, and also knew several past win- 
ners who encouraged me to apply. Two 
of the USF I-O faculty members are 
principal investigators on the larger 
grant that funds the Sunshine Educa- 
tion Research Center. They, along with 
past awardees, informed me of the 
award. 

Justina: Periodically throughout the 
academic year | searched my univer- 
sity’s website as well as websites that 
tend to fund I-O psychology topics re- 
garding grant opportunities for the up- 
coming academic year or summer. 
When | found one that fit into my topic 
area, | decided to apply, ensuring that | 
had enough time to produce a quality 
application. 


Some readers may not be familiar with 
how to start or what the procedure is 
like. Can you describe the application 
processes you completed? 

Rachael: Applications are due in the 
fall. | had to write three 2-page essays: 


a personal statement, a statement de- 
scribing my past research experience, 
and one about my proposed research. 
These topics are fairly similar to what 
was required for graduate school appli- 
cations, so those served as a good start- 
ing point for writing the statements re- 
quired by the GRFP. Transcripts and 
three references are required, and there 
is an online application to complete. 
Ryan: The application process for the SIOP 
award was quite simple. | submitted a 
shortened 12-page version of my disserta- 
tion proposal along with my curriculum 
vitae and letters of support from my major 
professor and graduate program director. 
The application process for the NIOSH 
award was more rigorous, akin to a larger 
grant application. The main proposal was a 
10-page document that included the sec- 
tions that are required in an NIH grant 
(abstract, specific aims, background and 
significance, research design and methods, 
dissemination plan and future research, 
human/animal subjects, references, con- 
sultants/faculty advisors, and resources). | 
was also required to submit a detailed 
budget and justification. Fortunately, 
unlike a typical NIH grant, | did not have to 
go through several rounds of revisions. 
Justina: The funding agency required a 
brief study description including the 
topic in general (approximately two 
pages), how it related to this specific 
grant (i.e., why | needed archival data), 
and a very general explanation of the 
study method. | also had to include my 


curriculum vitae and a writing sample. 
Then | waited and hoped for the best! 


The results suggest that you each sub- 
mitted quality applications! What kind 
of support did you get from your men- 
tor or major professor? 

Rachael: Because | was able to start work- 
ing on a few projects with my advisor the 
summer before | started graduate school, 
| had a good sense of what research areas 
| wanted to explore and past research on 
the topic. In the essays, | was able to high- 
light this research experience, as well as 
several conference presentations | had 
submitted based on our research. She 
was very supportive and encouraging, and 
being able to work on research over the 
summer with her helped give shape to my 
research proposal. 

Ryan: My major professor provided sup- 
port in developing the dissertation re- 
search project that was ultimately 
awarded funding. In addition, she provided 
letters of support, and assisted in the de- 
velopment of the NIOSH application based 
on her previous experiences with other 
students applying for the award. 

Justina: My dissertation advisor gener- 
ously spent the time to look over my 
project description and was willing to 
give advice regarding the importance of 
being clear and concise, yet descriptive 
enough to show that | had a solid re- 
search idea. He was very supportive of 
even the attempt to obtain such funding 
for the learning experience. 
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Three cheers for great advisors! Looking leads to some relinquished control, and 


back, what was the biggest challenge 
of your funding experience? 

Rachael: Although | had a lot of ideas 
about my research and had recently 
submitted papers for the annual SIOP 
conference, | still hadn’t fleshed out all 
of the details about what | would be re- 
searching over the next several years. | 
had to think about the directions my 
research could go and decide what to 
highlight in my proposed research essay. 
Also, because applications are due in the 
fall, it can be hard to find time to work 
on the application given all of the other 
commitments one has as a student. 
Ryan: Although the SIOP award was very 
straightforward, the NIOSH award has 
presented some challenges. The process 
of actually gaining access to the 
awarded funds was a big learning ex- 
perience. In addition to communicating 
with the actual funding source, | also 
had to work with my own department’s 
grant administrator, a grant administra- 
tor in another department where the 
funding opportunity originated, and my 
university’s office of sponsored research 
and the business accounting office. In 
addition, | was responsible for soliciting 
outside vendors for things like printing 
needs and participant compensation. 
There have also been frequent progress 
reports and budget updates to generate, 
and managing the use of the funds has 
been a challenge. I’ve found that having 
a third party involved in your research 
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things can take much longer to accom- 
plish than they might otherwise. 
Justina: As graduate school requires con- 
stant juggling of responsibilities and pro- 
jects, the most challenging aspect of this 
experience for me was to simply decide 
to spend the time to search out these 
opportunities in the midst of everything 
else required from me. | am now a big 
advocate for fellow graduate students to 
invest this time as it aids in building our 
experience surrounding grant proposals 
in general, which is often essential or per- 
haps even more important to our careers 
after we graduate. 


Those examples provide a nice realistic 
preview for your peers! To complete the 
picture, tell us about the most rewarding 
part of obtaining that funding support! 
Rachael: Being able to focus on research 
as a graduate student is rewarding. | have 
been able to devote a lot of time to my 
primary stream of research while also be- 
ing able to work on a variety of other pro- 
jects. This has allowed me to round out 
what I’ve learned in the classroom with a 
lot of “hands on” research experiences. | 
enjoyed having several projects each year 
to present at SIOP and was also fortunate 
to have the flexibility to be able to attend 
other conferences outside of the annual 
SIOP conference, including the SIOP Lead- 
ing Edge Consortium on Sustainability at 
Work, the annual IPAC conference, the 
Equality, Diversity, and Inclusion confer- 


ence, and student conferences at my uni- 
versity. The GRFP’s emphasis on the 
broader impacts of one’s research is also a 
good guiding principle that | have tried to 
emulate. Working with the University of 
Minnesota sustainability office on several 
of their initiatives has given me applied 
experience early on and has kept me fo- 
cused on the practical implications of my 
research and how it can be applied in or- 
ganizational settings. | have also enjoyed 
mentoring students who have worked 
with our research team. Keeping broader 
impacts in mind has helped me better 
communicate research findings and has 
made my research more rewarding. 

Ryan: The SIOP award has been very 
rewarding in that it has provided my 
dissertation project with a lot of visibility 
among SIOP members. | was often 
stopped at the most recent conference 
and asked about my research, which 
was very exciting. The most rewarding 
part of both awards was having the abil- 
ity to conduct high-quality research in a 
methodologically rigorous fashion. With- 
out the funding provided by these 
awards, | would not have been able to 
collect the appropriate data for my dis- 
sertation study. In addition, | believe 
that showing evidence of previous fund- 
ing will help my chances of receiving 
larger external grants in the future. 
Justina: Honestly, one of the most re- 
warding parts was hearing back from the 
selection committee that | was awarded 
the grant! It is gratifying to know that 


my hard work paid off. Secondly, what 
was very rewarding was the time that it 
opened up for my research and dedi- 
cated focus to my dissertation. 


In closing, what advice would you give 
to graduate students seeking a grant 
similar to yours? 

Rachael: Spend some time looking at the 
program solicitation and successful es- 
says and then tailor your essays accord- 
ingly. For instance, the NSF GRFP puts a 
heavy emphasis on broader impacts and 
intellectual merit of the research and 
makes ratings based on these criteria. 
Use language from the solicitation itself 
(e.g., “broader impacts”) to directly ad- 
dress and highlight how your research 
meets those criteria. 

Ryan: Seek out the advice and help of 
past students who have applied for (and 
hopefully won!) the awards in which you 
are interested. For me, being able to see 
what a winning application looked like 
before applying was really helpful. Also, 
be sure to know your audience and spe- 
cifically address the goals of the award 
for which you are applying. Although 
each of my awards was for the same 
research project, the focus of each appli- 
cation was very different. Some general 
advice for receiving funding is to search 
for opportunities, especially for less 
popular awards. Some awards have 
very few applications submitted. Many 
award applications are straightforward 
and relatively easy to complete, so | 
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would urge students to apply far and 
wide, and to also consider awards with 
descriptions that may not exactly match 
the type of research they want to con- 
duct. Often you can carry out the re- 
search you want to as part of a larger 
project that meets the requirements of 
the funding source. Some I-O topics are 
less “fundable” than others, thus neces- 
sitating some creativity or collaboration 
with researchers in other content areas 
in order to apply for funding. 

Justina: Go for it! There is really nothing 
to lose. Even if you don’t get funded, 
you will definitely walk away learning 
something new from the application 
process itself, which better prepares you 
for the next grant application. 


A Look Ahead to the Next Yes You Can: 
l-Os and Funded Research 


Thank you Ryan, Rachael, and Justina for 
the realistic job preview of research 
funding during graduate school! It’s 
helpful to explore the variety of funding 
mechanisms and opportunities out there 


for graduate students—and it is inspiring 
to learn how peers have succeeded! 


Stay tuned for upcoming issues in which 
we bring you stories of cross-discipline 
and cross-cultural collaboration, early 
career (postgraduate) start ups, and the 
“1-O world records” of grant experi- 
ences! So what characteristics would 
define your “ideal” funding opportunity 
as an I-O psychologist? Give it some 
thought and dare to get excited! And 
until next time remember: Yes You Can! 


Graduate Student Funding Sources 
NSF graduate research fellowship program 
NIOSH Education Research Centers 
(many offer pilot grants that those in the 
region may be applicable for) 

SIOP Graduate Student Awards 

APA resources 

Association for Psychological Science (APS) 
resources 

SHRM resources (master’s students only) 

HumRRo Meredith P. Crawford Fellowship 
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Internship 


The Human Resources Research 
Organization (HumRRO) is pleased 
to sponsor paid summer internship 
opportunities for graduate students 
in Industrial-Organizational (l-0) 
Psychology* accredited programs. 


Application Deadline: February 1 
For more information and application 
materials visit our website at 
www.humrro.org 


* or students ine 
closely related fields 


H RR Custom solutions for your human 
um ® capital and measurement challenges 


Human Resources Research Organization 


66 Canal Center Plaza, Suite 700, Alexandria, Virginia 22314-1578 
Phone: 703.549.3611 ™ Fax: 703.549.9661 ™ www.humrro.org 
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Using I-O Psychology to Enhance Maternal 
Health and Child Healthcare in India 


Greetings T/P readers, and welcome to our second is- 
sue of the Spotlight on HWP column! In this column, 
we are focusing upon issues of humanitarian work psy- 
chology, that is, on the synthesis of industrial- 
organizational psychology with deliberate and organ- 
ized efforts to enhance human welfare. In this issue, 
we are placing our spotlight on the work of Dr. Ruth 
Kanfer, Dr. Rustin Meyer, and Ms. Carla Burrus at the 
Georgia Institute of Technology, who through a part- 
nership with CARE (www.care.org), one of the world’s 
largest and most influential international humanitarian 
agencies, are helping to improve healthcare delivery in 
India. The work of the team from Georgia Tech helps 
to illustrate the relevance of I-O psychology to the hu- 
manitarian and international development sector. In- 
deed, Melinda Gates, co-founder of the Bill & Melinda 
Gates Foundation (BMGF), has cited this effort as a 
notable success in international development work 
(see this link; CNN-IBN, 2013). 


CARE (Cooperative for Assistance and Relief Every- 
where) is an international humanitarian agency that 
engages with a number of issues including water and 
sanitation, economic development, education, and 
health in over 80 countries around the world. Specifi- 
cally, the Georgia Tech team is engaging with CARE on 
their Ananya Program—funded by BMGF—which 
seeks to transform public health in India’s poorest 
state of Bihar and to improve the health and survival 
of women, newborns, and children. 


In large part, effective healthcare delivery in impover- 
ished areas such as Bihar relies upon a policy approach 
known as task shifting. In the international develop- 
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ment community, task shifting refers to 
when “specific tasks are moved, where 
appropriate, from highly qualified health 
workers to health workers with shorter 
training and fewer qualifications in order 
to make more efficient use of the avail- 
able human resources for 

health” (World Health Organization, 
2008, p. 2). In the case of India, many 
tasks related to maternal health have 
been delegated to frontline healthcare 
workers who, at least from a traditional 
Western or U.S. perspective, might not 
normally be responsible for such duties. 
Frontline healthcare workers are critical 
in India due to a severe shortage of pro- 
fessionally trained doctors and nurses 
and to infant mortality rates of over 44 
children per 1,000 live births (compared 
to 2.17 in Japan or 5.90 in the United 
States; Central Intelligence Agency, 
2013). The need for these workers is 
especially great in Bihar, a state which 
lags behind others in India with poverty 
rates (53.5%) almost twice that of the 
rest of the country and with over half of 


its children under the age of 5 
being underweight (United 
Nations Development Pro- 

y gramme, 2013). 


In general, Rustin and Ruth 
were charged with helping to 
increase the performance and 
cooperation of three different 
types of frontline healthcare 
workers. We now turn to the 
team at Georgia Tech to hear more about 
their work with CARE in India and about 
how I-O psychology has been, and can be, 
used to enhance humanitarian and devel- 
opment efforts. 


An Interview With Drs. Rustin Meyer 
and Ruth Kanfer 


Can you tell us more about how you 
came to work with CARE? 

Quite fortuitously actually. In 2011, a 
graduate student in our l-O program, 
Carla Burrus, described l-O to a CARE 
employee at a social gathering. The em- 
ployee grew interested and contacted us 
to set up a meeting. Ruth has a long 
track record of working with interna- 
tional development organizations, and 
Rustin had become very interested in 
the growing subdiscipline of humanitar- 
ian work psychology, so this project was 
a great opportunity and a natural fit for 
our team. Ruth’s experience in this 
arena proved invaluable as she had both 
engaged with the issue of health worker 
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motivation (e.g., Franco, Bennett, & 
Kanfer, 2002) and had delivered a report 
on the subject for the United States 
Agency for International Development 
(Kanfer, 1999). Meanwhile, Rustin’s ex- 
pertise in situational strength provided a 
lens through which we were able to help 
CARE develop a more effective incentive 
based intervention. 


What was your specific objective in the 
project? 

CARE had identified that a major obsta- 
cle to improving maternal and child 
healthcare was a lack of cooperation 
between three different types of front- 
line healthcare workers. One group, 
known as Accredited Social Health Activ- 
ists (ASHAs), has the job of encouraging 
pregnant women in their communities 
to give birth in a modern hospital, pro- 
viding education about prebirth health, 
and providing basic resources like iron 
folate tablets to keep women and their 
unborn children healthy. ASHAs are hy- 
brid volunteers who are paid a small 
monetary incentive for every woman 
whom they convince to give birth in hos- 
pitals. The second group of frontline 
healthcare workers, women known as 
Anganwadi workers, are volunteers who 
are responsible for early childcare in 
their communities, including preschool 
education and the distribution of food 
rations. The third group, Auxiliary Nurse 
Midwives, are salaried employees who 
oversee the ASHA and Anganwadi work- 
ers. In the past, these three groups of 


frontline health workers did not see 
themselves as part of the same team, 
despite their overlapping objectives and 
the fact that they were supposed to hold 
monthly “health subcenter” meetings in 
their communities. Indeed, workers of- 
ten reportedly grew resentful of others 
over issues of compensation, pay, and 
perceived beneficiary poaching. 


Prior to our involvement in the project, 
CARE had begun to develop training re- 
sources for the frontline healthcare 
workers and a more effective monthly 
health subcenter meeting structure. The 
centerpiece of this intervention was a 
team-based incentive system that was 
intended to address performance and 
cooperation failures by providing the 
three groups of frontline healthcare 
workers with common goals in seven 
performance areas. For those health 
subcenter teams that met a given quar- 
terly goal, all members of the team 
would receive a small nonmonetary re- 
ward from a list of household items 
(e.g., a nonstick cook pan). Because the 
framework for this program was already 
in place when we became involved, our 
role primarily revolved around “fine tun- 
ing” the specifics of this reward system 
(e.g., utilizing partial rewards of partial 
goal attainment, implementing rewards 
on a manageable quarterly basis, en- 
couraging teams to set informal monthly 
goals) and focusing the meeting struc- 
ture on team development and perform- 
ance (e.g., by beginning each meeting 
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with a pledge that workers recited to 
reaffirm their commitment to their 
team/community, formally tracking goal 
progress, encouraging employees to dis- 
cuss potential solutions to difficult situa- 
tions they have experienced). 


The ultimate success of this initiative will 
be determined by whether teams at vari- 
ous health subcenters are able to im- 
prove their performance according to the 
specific targets set for them. To evaluate 
this program, subcenters where we intro- 
duced meeting reforms and incentives 
are being compared by an independent 
research team to those wherein only the 
new monthly meeting was introduced. 
Although final results are still pending, 
anecdotal evidence appears promising. In 
addition to our more “consulting ori- 
ented” role, CARE is helping us collect 
data on relevant psychological and team 
processes, which we hope will not only 


help inform the development of related 
interventions but might also be publish- 
able in I-O journals. 


How did I-O psychology play a role in 
this project? 

In the course of working together with 
CARE, it has become apparent that 
nearly all international development 
work has an organizational component 
to it, but most development agencies’ 
areas of expertise lie in the domain of 
public health. Thus, they often do not 
have the expertise necessary to address 
the interpersonal and organizational 
dynamics that sometimes stand in the 
way of project success. By joining the 
project, we brought a complementary 
perspective to the CARE team by focus- 
ing in on human behavior, team proc- 
esses, and theories of behavior change. 
This included insights from organiza- 
tional development, training, team de- 
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velopment, and motivation. Thus, per- 
haps the greatest contribution of I-O 
psychology to this, and similar projects, 
might be I-O psychologists’ interest in 
and focus upon organizational and be- 
havior processes, as opposed to just out- 
comes. Development work is necessarily 
a heavily outcome-based industry be- 
cause scarce resources need to be allo- 
cated to those projects that get results. 
However, it seems that insight into why 
projects did or did not work is often lost 
because theories and measurement of 
human behavior are underexamined. 


What difficulties have you experienced 
on this project that you have not in 
other applied-research projects? 

This project presented great challenges, 
both to our theories and our research 
methods. First, many cross-cultural 
norms and socioeconomic factors (e.g., 
low levels of literacy) were at play that 
we were not accustomed to in our work 
in the United States. For example, when 
we asked frontline health workers how 
they would like to change their jobs, we 
were met by blank stares because the 
idea that they could change the way 
they perform their job was a deeply for- 
eign concept. Also, we had to consult 
with experts about how unforeseen ex- 
ternal forces might affect both the out- 
comes of interest and team processes. 
For example, some communities experi- 
ence prolonged geographic seclusion 
due to flooding, some have unique dy- 
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namics due to the presence of religious 
minorities, and the constraints of the 
social caste system inevitably play a role 
in access to scare resources. 


Second, our research methods were espe- 
cially put to the test. For example, struc- 
tured interviews were difficult due to the 
bustling health subcenters where standers 
-by would frequently disrupt the inter- 
views, interviewees would consult with 
colleagues on their answers, and long de- 
lays due to translation issues (not to men- 
tion sitting on the dirt floors of non-air 
conditioned buildings in 110 degree 
heat!). Moreover, we tried to administer 
surveys with Likert scales, but there is a 
strong cultural norm of acquiescence 
among this population, and it was difficult 
for respondents to distinguishing between 
adjacent response options (e.g., strongly 
agree vs. agree)—both of which led to 
issues of severe range restriction. To cir- 
cumvent these issues, we have since 
shifted to collecting very behaviorally 
driven response options, but this ap- 
proach carries its own challenges, such as 
ensuring that behavioral options are maxi- 
mally relevant and comprehensive. 


Do you have any advice for I-O 
psychologists looking to work with 
humanitarian organizations? 

One of the first things is to encourage I- 
Os to give a talk at a development or- 
ganization in your area. We’ve found 
that Guidestar is a particularly useful 
tool for finding not-for-profit agencies, 


learning about their missions, and find- 
ing key contacts therein. In our limited 
experience in this area, we have been 
very pleasantly surprised by how favora- 
bly members of the development com- 
munity have received our perspective 
and areas of expertise. 


Second, take nothing for granted. Chal- 
lenges operate at all levels of HWP re- 
search and practice. Obviously, socio- 
cultural variables play a major role in 
developing countries, and the multitude 
of direct and indirect ways that these 
variables affect employee attitudes and 
behaviors needs to be carefully taken 
into account. In politically unstable 
countries, the personal safety of em- 
ployees (in particular women) may be a 
major barrier to even traveling to/from 
work, so issues of job design, team coor- 
dination, and so on often take a back- 
seat to more pressing needs. 


Operationally, there are also many chal- 
lenges. Most obviously, you will travel to 
remote areas of the world, there are ma- 
jor time-zone differences with in-the-field 
colleagues, and this work often involves 
large and diverse teams with different 
priorities and timeframes. But beyond 
these logistical issues, there are also unre- 
solved issues of construct validity/ 
measurement equivalence stemming from 
translating measures, using instruments 
that have been validated in developed 
countries, the influence of cultural norms 


at every step, and gathering data among 
participants with low literacy rates. 
Third, think broadly about what moti- 
vates employees in developing econo- 
mies and non-Western cultures. In the 
developing world, financial rewards are 
often not possible due to a lack of re- 
sources, so attempts to increase work 
motivation and engagement must often 
rely on nonfinancial incentives. In India, 
a strong precedent is placed on social 
recognition and incentives that can be 
used to improve collectives. For exam- 
ple, many women we spoke to reported 
giving their incentives to their daughters 
or coordinating with their colleagues to 
select incentives they can share. As 
such, it is important to differentiate be- 
tween those incentives that enhance 
work motivation, skill acquisition, and 
job engagement by encouraging skill 
learning and personal/professional de- 
velopment versus those that help to 
build stronger social/affiliative ties. 


Fourth, understanding the complexities of 
multilevel forces that operate in develop- 
ment settings is critical. The volatility of 
the environment in developing countries 
makes analysis of motivational and per- 
formance problems more difficult. In con- 
trast to developed countries, family and 
community memberships often exert 
strong influence on behavior that func- 
tions within a broader cultural context. 
Further, more top-down considerations 
such as governmental policies and even 
corruption might influence what is possi- 
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ble/prudent in a particular setting. Thus, 
interventions to enhance work motivation 
and performance may be best accom- 
plished by identifying the overlapping 
goals of these different groups and creat- 
ing environments and reward systems 
that promote new synergies for action. 


Finally, jump right in. HWP work is inevita- 
bly interesting, challenging, and reward- 
ing. Recognize that we have a skill set that 
the development community is looking 
for, which creates nontraditional opportu- 
nities for collaboration, research, and 
learning that will change your life. 


Conclusion 


Thank you to Drs. Meyer and Kanfer for 
their time in giving us a picture of their 
work with CARE in India. Their work 
there serves as a fantastic example of 
the relevance of l-O psychology to delib- 
erate and organized efforts to enhance 
human welfare! As they illustrated, 
while I-O psychologists from Western/ 
U.S. settings might encounter many 
challenging, and foreign, theoretical and 
practical dynamics when working in non- 
Western and lower-income settings, the 
potential contributions of I-O psychology 
are often extremely beneficial and stand 
the chance of dramatically improving 
the welfare of some of the world’s most 
vulnerable and marginalized popula- 
tions. It seems likely that the need for 


task shifting will remain strong as the 
fight to improve maternal and child 
health continues. It obvious from the 
report from the team at Georgia Tech 
that I-O psychology has much to add to 
this effort and we are confident that 
their work is, and will be, only one ex- 
ample of I-O psychologists getting in- 
volved in this important global issue. 
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On the The Latest on EEO Challenges 
Legal Front to Background Checks 


Introduction 


Shortly before this article was due, EEOC lost a high 
profile background check challenge on summary judg- 
ment. The case, EEOC v. Freeman, ended when a judge 
ruled that the agency could not show that the criminal 
history check had adverse impact against black appli- 
cants. This ruling mirrored some aspects of another 
high profile summary judgment background check rul- 
ing against the agency in EEOC v. Kaplan, where a 
judge ruled that EEOC could not persuasively show 
that a credit screen had adverse impact against minor- 
ity candidates. Interestingly, these rulings came after a 
series of background check settlements that were per- 
ceived by the EEO community as EEOC victories, in- 
cluding one against Pepsi and most recently, against 
J.B. Hunt. EEOC also recently publicized two other 
criminal history challenges, one against a BWM manu- 
facturing facility and another against Dollar General. 


Eric Dunleavy 
DCI Consulting Group 


Until recently, criminal history and credit screens used 
as background checks for employment were fairly un- 
common when it came to EEO challenges. However, 
under the Obama administration, the EEOC has fo- 
cused on a number of non-traditional selection tools, 
including these common post offer screens. Criminal 
history and credit checks are selection tools that can 
be challenged under both pattern or practice (if used 
in facially discriminatory ways) and disparate impact 
theories (if used in facially neutral ways but producing 
adverse impact against members of a protected 

Art Gutman group). In the disparate impact scenario, Uniform 
Hoida Tada Guidelines style standards related to adverse impact 
measurement and validation research would seem to 
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apply. Most of the activity described in 
this article relates to disparate impact. 


In this article we describe how and why 
criminal and credit screens ended up on 
EEOC radar. We review recent and histori- 
cal EEOC and OFCCP guidance on the mat- 
ter, as well as the rulings in Kaplan and 
Freeman. We also consider a recent re- 
sponse by nine state attorney generals, 
who have taken exception to EEOC chal- 
lenges to criminal history screens. We 
conclude with implications for l-O Psy- 
chologists, and include some perspective 
from Kevin Murphy, who was involved in 
both Kaplan and Freeman on behalf of 
EEOC and was willing to share his view. 


Some Context and Agency Guidance 


In the spring of 2012, EEOC provided 
guidance on arrest/conviction records 
that largely went under the radar. That 
guidance really didn’t provide anything 
new, and instead reiterated standards 
from Green v. Missouri Pacific Railroad 
(or MOPAC), in which the 8th Circuit 
outlined factors for assessing conviction. 
MOPAC had an absolute policy of ex- 
cluding individuals convicted of crimes 
other than minor traffic offenses. Buck 
Green served 21 months in prison for 
refusing military induction, and was ex- 
cluded by MOPAC for a clerk job. The 
district court granted summary judg- 
ment for MOPAC, but the 8th Circuit 
reversed, ruling: 
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We cannot conceive of any business 
necessity that would automatically 
place every individual convicted of any 
offense, except a minor traffic offense, 
in the permanent ranks of the unem- 
ployed. This is particularly true for 
blacks who have suffered and still suffer 
from the burdens of discrimination in 
our society. To deny job opportunities 
to these individuals because of some 
conduct which may be remote in time 
or does not significantly bear upon the 
particular job requirements is an unnec- 
essarily harsh and unjust burden. 


The 8th Circuit then outlined four fac- 
tors for assessing conviction records, 
namely: (1) nature and seriousness of 
the crime in relation to the job sought; 
(2) time elapsing since the conviction; 
(3) degree of the felon's rehabilitation; 
and (4) the circumstances under which 
the crime was committed. These factors 
were referred to as the “Green factors” 
during the commission hearing. 


This updated guidance was followed up 
by a public hearing held in December of 
2012. During the meeting representa- 
tives for ex-offenders hailed the EEOC 
guidance as a warning to employers to 
cease using criteria that adversely affect 
opportunities for Blacks and Hispanics to 
re-enter the workforce. Representatives 
of employers, however, complained that 
the guidance presents legal complica- 
tions for employers using background 


checks because they are compelled by 
federal, state, or local laws to exclude 

applicants based on particular types of 
past convictions. 


About a year later, OFCCP published Di- 
rective 306, which essentially reiterated 
EEOC’s 2012 guidance, and stressed that 
employers should conduct an individual- 
ized assessment of the job-relatedness 
of a conviction to the job to which the 
candidate applied. OFCCP also adopted 
EEOC’s guidance that, where disparate 
impact occurs, employers must validate 
their criminal background check policies. 


Both agencies cited numerous statistics 
reflecting that minorities are dispropor- 
tionately disqualified by criminal back- 
ground checks. For example, OFCCP indi- 
cated African Americans make up about 
13 percent of the country’s population, 
but constitute 40 percent of the currently 
incarcerated population. The Directive 
also reported that 1 in 15 African- 
American men and 1 in 36 Hispanic men, 
as compared to 1 in 106 White men, are 
incarcerated during their lifetime. 


To avoid unnecessary exposure, the 
agencies recommend that employers 
refrain from inquiring about criminal 
history on job applications. Where such 
information is requested, an 
“individualized assessment” that is 
“narrowly tailored to the essential job 
requirements and actual circumstances 


under which the jobs are performed” is 
needed. Mirroring Green standards, 
such consideration should include (1) 
the nature or gravity of the offense or 
conduct; (2) the time elapsed since the 
offense, conviction, and/or completion 
of the sentence; and (3) the nature of 
the job sought or held. An alternative 
approach is to conduct a validation 
study similar to that used in establishing 
the job relatedness of other selection 
tools. 


With regard to credit checks, the com- 
mission had a similar meeting in late 
October 2010 that focused on the use of 
credit checks in hiring. The two basic 
views expressed were that credit history 
is unfairly exclusionary, particularly dur- 
ing times of economic recession, or that 
credit histories can be predictive in cer- 
tain situations when they are limited in 
scope. SIOP’s own Michael Aamodt tes- 
tified at the hearing on issues of job- 
relatedness, and concluded that there is 
considerable research on credit scores in 
relation to consumer decisions, but little 
research on their use in the employment 
context. He suggested that in view of 
the potential for discriminatory exclu- 
sion, it would be best to limit the use of 
credit history within the context of a 
thorough background check. 
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Early Contemporary Settlements 


In early 2012 EEOC settled with Pepsi Bev- 
erages in a $1.3 million agreement to 
head off litigation. According to the EEOC, 
Pepsi used arrest and conviction criteria, 
which adversely impacted Blacks, and 
therefore were illegal under Title VII. 
More specifically, the EEOC noted: 


When employers contemplate institut- 
ing a background check policy, the 
EEOC recommends that they take into 
consideration the nature and gravity 
of the offense, the time that has 
passed since the conviction and/or 
completion of the sentence, and the 
nature of the job sought in order to be 
sure that the exclusion is important 
for the particular position. 


According to the press release, the EEOC 
began its investigation in 2007 after an 
applicant filed a charge with the EEOC 
for an arrest even though his case had 
yet to be prosecuted. Based on its inves- 
tigation, more than 300 individuals were 
illegally excluded between 2006 and 
2010. Apparently, Pepsi also excluded 
applicants guilty of minor offenses bear- 
ing no relationship to the requirements 
of the at issue jobs. Pepsi also agreed to 
hire class members in their top three job 
location preferences, and to report to 
the EEOC on a regular basis on its new 
background check policies, which were 
initiated prior to the actual settlements. 
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A more recent EEOC settlement involved 
J.B. Hunt. Although there is little detail 
in the press release, the allegation cen- 
ters on a Black candidate for a truck 
driver position at a J.B. Hunt facility in 
San Bernardino, CA who was denied em- 
ployment based on his criminal convic- 
tion record. There were no specifics re- 
lating to the actual criminal conviction(s) 
other than the EEOC’s assertion that it/ 
they were unrelated to the job duties. 
The excluded applicant settled privately 
with the company. 


More importantly perhaps was the 
EEOC’s examination of potential blanket 
prohibitions, which the EEOC warns 
against based on its Policy Guidance. 
Accordingly, J.B. Hunt agreed to a five- 
year plan to review its policies and re- 
vise them, if necessary. J.B. Hunt agreed 
to provide additional training relating to 
its hiring and selection policies in accor- 
dance with the Policy Guidance, and the 
EEOC will monitor compliance with the 
conciliation agreement. 


Based on these settlements, EEOC ap- 
peared to have momentum based on 
voluntary settlements. That changed 
with the Kaplan ruling. 


The Kaplan Ruling 
EEOC v. Kaplan Higher Learning was de- 


cided on January 28 by Judge Patricia A. 
Gaughan of the District Court for the 


Northern District of Ohio, Eastern Division 
(2013 U.S. Dist. LEXIS 11722). The EEOC 
claimed that Kaplan’s use of credit reports 
adversely impacted Black applicants. The 
defense challenged the EEOC’s expert 
report showing there was adverse impact. 
Judge Gaughan ruled that the EEOC’s re- 
port was inadmissible under Daubert 
standards, and therefore, there was no 
evidence of adverse impact. As a result, 
Kaplan was awarded summary judgment. 


Kaplan’s use of credit checks was limited 
to certain sensitive positions and was 
designed to determine if applicants 
were under “financial stress or burdens 
that might compromise their ethical ob- 
ligations.” The credit histories of appli- 
cants given a conditional offer of hire 
were first reviewed by an outside credit 
agency, General Information Services 
(GIS), to determine the presence of one 
or more of ten potential “flags.” If the 
flags existed, the credit history was then 
reviewed by Kaplan’s controller who 
could override the flags if other evi- 
dence suggested the flags were not an 
accurate picture of potential financial 
stress for a particular applicant. 


EEOC argued that this credit history re- 
view had adverse impact against Black 
applicants and was not job related. Kap- 
lan’s two experts argued that EEOC’s 
analyses had two serious flaws: (1) no 
control for important variables such as 
the job applied for, and (2) because race 
information was not available for the full 


set of applicants, EEOC’s use of “race rat- 
ers” to determine race from applicants’ 
driver’s license photos was unreliable. 


The key ingredient in Judge Gaughan’s 
rulings was that the proof of adverse 
impact, based entirely on the EEOC’s 
expert report, was not based on objec- 
tive self-report tallies of applicant race, 
but rather, subjective approximations 
based on agreement among raters on 
race classifications (e.g., African Ameri- 
can, Caucasian, Hispanic, Asian, or 
other). Kaplan called the “race rater” 
technique “guesswork” and offered rea- 
sons why it failed under Daubert stan- 
dards, which require evidence that: (1) a 
technique or theory can be or has been 
tested; (2) whether it has been subject 
to peer review and publication; (3) the 
known or potential rate of error of the 
technique or theory; (4) the existence 
and maintenance of standards and con- 
trols; and (5) whether the technique or 
theory has been generally accepted in 
the scientific community. Kaplan’s attor- 
neys challenged the EEOC’s expert re- 
port on each of these dimensions, and 
Judge Gaughan agreed, ruling: 


Upon review, the Court finds that the 
expert reports and testimony provided 
by [EEOC’s expert] are inadmissible 
because plaintiff fails to present suffi- 
cient evidence that the use of "race 
raters" is reliable. Simply put, plaintiff 
offers no evidence sufficient to satisfy 
any of the Daubert factors. 
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The Freeman Ruling 


EEOC v. Freeman first made headlines 
back in 2012 when Freeman attorneys 
moved to depose EEOC on its own use 
of background checks. It isn’t surprising 
to hear that many federal agencies, in- 
cluding EEOC, use background checks in 
one way or another as part of their se- 
lection system. This early ruling was de- 
cided in August of 2012 by Judge Charles 
B. Day, Magistrate for the District Court 
of Maryland. The facts are that the EEOC 
sued Freeman on grounds that its use of 
background checks and criminal records 
adversely impacted Blacks, Hispanics, 
and males. Freeman then moved to de- 
pose the EEOC regarding its own use of 
background checks and criminal history, 
to which the EEOC filed a motion for a 
protective order and Freeman filed its 
own motion. Judge Day rejected both 
motions and ruled that a hearing on 
them is unnecessary. Judge Day exam- 
ined three issues. 


First, the EEOC argued that the deposi- 
tion would not discover information 
relevant to claims and defenses in this 
case because Freeman has (1) not pled 
an equitable estoppel defense and (2) its 
business necessity defense lacks merit. 
On the estoppel issue, Judge Day ruled: 


Because Defendant failed to include 
equitable estoppel as an affirmative 
defense in its Answer and has not yet 
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obtained leave to amend its Answer to 
include this defense, discovery of mat- 
ters relating to this affirmative de- 
fense are not relevant, and Defendant 
cannot depose Plaintiff on topics re- 
lated to this defense. 


And on the issue of the business neces- 
sity defense, Judge Day ruled that the 
EEOC: 


[C]annot avoid a deposition because it 
believes that Defendant's business 
necessity defense is baseless. Argu- 
ments regarding the merits of claims 
or defenses asserted in pleadings 
"[are] not the kind[s] of argument[s] 
that the Court can adequately enter- 
tain in a discovery dispute." 


Second, the EEOC argued it cannot be 
deposed because the Office of Person- 
nel Management (OPM) formulates and 
conducts all hiring procedures and, as a 
result, it does not itself have the author- 
ity to make “suitability determinations.” 
Judge Day's ruling on this issue was: 


[E]ven if Plaintiff uses OPM's federally 
mandated procedures, the facts show 
that Plaintiff is involved in the hiring 
process, and so Defendant's 30(b)(6) 
deposition of Plaintiff regarding its 
actual involvement in that process and 
the process itself would provide rele- 
vant information. 


Third, the EEOC argued that a deposition 
would be "unduly burdensome, duplica- 
tive and interfere with agency function- 
ing" because (1) such information is al- 
ready available and is, therefore redun- 
dant; (2) Freeman already had ample 
opportunity to obtain the information it 
wanted; and (3) “the burden or expense 
of the proposed discovery outweighs its 
likely benefit.” Judge Day rejected all 
three arguments. 


An actual ruling on the merits of the case 
was handed down in August of 2013 by 
Judge Roger W. Titus of the District Court 
of Maryland. After much wrangling, the 
case reduced to whether adverse impact 
was identified. It boiled down to an evalua- 
tion of selection rates for two classes, in- 
cluding: (1) 51 Black applicants passed over 
between March 23, 2007, and Aug. 11, 
2011 because of credit histories, and (2) 83 
Black and male workers passed over be- 
tween Nov. 30, 2007 and July 12, 2012 
based on criminal records. In attempting to 
make a prima facie cases of adverse im- 
pact, the EEOC’s expert submitted an initial 
report that was admittedly flawed. 


A second report designed to correct the 
flaws was then submitted, and inde- 
pendently replicated by another expert. 
According to Judge Titus, despite the 
attempt to de-flaw the data, there re- 
mained a “mind-boggling number of er- 
rors,” most notably using “cherry- 
picked” data that supported the EEOC’s 


theory of adverse impact, but did not 
include data on all available applicants 
for the two classes for the entire class 
period. Judge Titus used various de- 
scriptors of the analysis, including 
“flawed,” “skewed,” “rife with analytical 
errors,” “laughable,” and “an egregious 
example of scientific dishonesty” de- 
signed to fit the EEOC’s theory. He also 
cited the EEOC’s failure to isolate a spe- 
cific selection practice that purportedly 
caused the adverse impact. 


In summary, in both Kaplan and Free- 
man rulings, the merit of the credit and 
criminal history screens were never for- 
mally evaluated. This was because in 
neither case did EEOC meet the first 
prong under disparate impact theory, 
identifying meaningful adverse impact. 
When considered together, these rulings 
appear to be a major roadblock to 
EEOC’s initiative. Yet another potential 
hurdle was waiting in July of 2013. 


State Attorney Generals Weigh in 


On July 25, 2013, a letter was submitted 
to EEOC authored by West Virginia Attor- 
ney General Patrick Morrisey. He was 
joined by attorneys general from Ala- 
bama, Colorado, Georgia, Kansas, Mon- 
tana, Nebraska, South Carolina and Utah. 
The letter was reprinted in the West Vir- 
ginia Record. The letter was in response 
to recent lawsuits against Dollar General 
(the 28th largest private employer in 
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West Virginia), and BMW Manufacturing 
Co. described earlier in the article. 
Morrisey’s main concern is that EEOC 
actions and guidance override state laws 
requiring criminal background checks. 
He noted “Our state has a number of 
laws that seek to protect the public in- 
terest by requiring potential hires to pass 
criminal background checks,” and as an 
example noted further than the EEOC’s 
guidance would relate to “any person 
who has been convicted of a felony here 
or in any other state from owning, being 
employed by or associating with a pain 
management clinic.” 


Morrisey disagreed with EEOC’s position 
that criminal background checks that 
adversely impact African Americans are 
often not job related, and that the 
EEOC’s actual concern is to expand Title 
VII protections to former criminals. He 
suggested that this protection is some- 
thing that Congress has never required. 
He also asserted that the EEOC lawsuits 
“defy common sense,” noting: 


An employer may have any number of 
nondiscriminatory reasons for not want- 
ing to hire people who cannot pass a 
criminal background check. Even if the 
use of criminal background checks in hir- 
ing might seem unfair to some, the law 
does not prohibit it. It is not the commis- 
sion’s role to unilaterally expand the pro- 
tections of Title VII under the pretext of 
preventing racial discrimination. 


The Industrial Organizational Psychologist 


He concluded that the lawsuit against 
Dollar General occurred in conjunction 
with West Virginia’s concerns that its 
businesses already face “multiple of bur- 
densome regulations” and that “the last 
thing we need is another federal agency 
freelancing and imposing even more un- 
necessary requirements.” At the time 
this TIP article was written, there had 
been no formal response to this letter. 


Implications for I-O Psychologists 


We hope that the above sections illus- 
trate the roller coaster ride that has 
been the contemporary EEO enforce- 
ment of background check issues. In the 
last 3 years we have seen public hear- 
ings, new guidance, major settlements 
in favor of EEOC, two major court rulings 
against EEOC, and a letter from nine 
state attorneys general requesting that 
EEOC stand down. Importantly, we think 
that this topic has implications for I-O 
psychologists doing selection work. 


First, whether you know it or not, there 
is a good chance that your organizations 
or your client organizations are using a 
background check in some form. Recent 
survey data from SHRM suggests that 
the majority of its members use a back- 
ground check in some capacity. Given 
this scenario, it is critical to have a clear 
understanding of what those processes 
are measuring, how they are being im- 
plemented, and whether they include 


individualized assessment or have been 
more formally validated. 

Second, it is important to consider 
whether these tools have adverse impact 
in practice. As the Kaplan and Freeman 
rulings show, this may be a more difficult 
research question to answer. We find this 
to be a particularly interesting issue. 
Broad societal data were used in agency 
policy documents to support the need for 
contemporary guidance on these issues 
(or at the very least a reminder that this 
guidance has been around for 30 years). 
In practice it is clear that there may not 
be readily available self-report applicant 
flow data to assess whether a particular 
screen has adverse impact against minori- 
ties for a particular job in a particular or- 
ganization. Given this scenario, the ques- 
tion becomes whether EEOC could lever- 
age other data sources. In the case of 
Kaplan, an alternative to self-report was 
race coding by raters, which was not well 
received. Perhaps the agency is also con- 
sidering some type of utilization analysis 
under an “adverse inference” theory that 
would function as a proxy in the absence 
of applicant flow. 


Third, it is important to note that con- 
ducting traditional validation research 
on background check screens may be 
difficult to impossible. From a criterion 
perspective, low base rate outcomes 
coupled with restriction of range may 
render criterion strategies impossible. 
This was essentially noted in Mike 


Aamodt’s testimony to EEOC on credit 
checks that we mentioned earlier. Mike 
scoured traditional and non-traditional 
literature and identified only ten studies 
that had empirical data linking credit 
data to work outcomes. There is even 
more-limited data on criminal history 
data. Given this scenario, could some 
type of content linkage be feasible? We 
think that it could be in some situations. 
Using job analysis methods to under- 
stand exposure to various background 
check content areas (e.g., money, sensi- 
tive information, other people, public 
trust) and the opportunity to engage in 
counter productive work behaviors may 
allow for reasonable inferences to be 
made. Presenting these considerations 
in a matrix form and linking them to spe- 
cific background check requirements 
may provide initial linkage data that sup- 
ports use for some jobs and not others. 
To our knowledge this approach has not 
been challenged in court, but on its face 
we consider it promising. 


From our perspective, EEOC’s choice to 
challenge Kaplan and Freeman on their 
background check policies was interest- 
ing. We aren’t involved in either of these 
cases and don’t know the exact details, 
but based on what is known publically, 
these cases don’t seem like low hanging 
fruit. In some ways the screens used by 
Kaplan and Freeman sound consistent 
with EEOC policy guidance. They ap- 
peared to use well-structured systems in 
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which background checks were not 
automatic exclusionary factors. The 
checks were tied to specific types of jobs 
where they seemed relevant, and flags 
were followed up to determine whether 
applicants should be excluded. 


Even more puzzling is the EEOC’s current 
complaint against Dollar General. Al- 
though we have not seen the statistical 
significance analyses regarding adverse 
impact, based on what has been made 
public it appears that 90% of Black appli- 
cants passed the criminal history check 
compared to 93% of non-Blacks. This dif- 
ference doesn’t appear to be practically 
significant. Furthermore, as with both 
Kaplan and Freeman, Dollar General used 
a targeted approach in which it consid- 
ered the nature of the crime as well as 
the amount of time that had passed since 
the conviction/release from jail. 


Having said that, we caution employers 
to refrain from ignoring EEOC guidance 
on background checks on grounds that 
Kaplan and Freeman are indicative of 
how all such cases will go in the future. 
Critically, neither of these cases got to a 
defense phase, which undoubtedly will 
occur in a future case if the EEOC does a 
better job of proving adverse im- 

pact. The best practice here is to be pre- 
pared to justify the use of your back- 
ground check process. 
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We end the column in an unusual but in- 
teresting way. As mentioned earlier, Kevin 
Murphy was involved in both cases as an 
expert for EEOC. Given common themes 
across the two cases related to an inabil- 
ity to demonstrate adverse impact, we 
thought it would be useful to reach out to 
Kevin to see if he would be willing to pro- 
vide context and lessons learned. Obvi- 
ously Kevin wasn’t excited about how 
these two cases played out, and he is 
coming from the perspective of working 
with EEOC on both cases. Regardless, he 
was generous enough to share some per- 
spective, and we appreciate it. 


Kevin’s Perspective 


Recent decisions in EEOC v. Kaplan and 
EEOC v. Freeman represent significant 
setbacks to EEOC’s attempt to challenge 
the use of credit and criminal back- 
ground checks in screening job appli- 
cants. The issues in both cases are clear. 
There is evidence that credit checks 
have adverse impact against Black and 
Hispanic applicants and that criminal 
background checks have adverse impact 
on male, Black and Hispanic applicants 
in a wide range of settings. There is 
scant evidence that credit or criminal 
background checks have real probative 
value when they are used for broad 
screening. For example, research on 
criminal background checks shows that 
the potential value of these checks for 
screening declines as the time between 


the offense and the employment deci- 
sion increases or as the similarity be- 
tween the offense and the specific be- 
havior to be predicted decreases (e.g., 
past theft predicts future theft, whereas 
past drug use may not predict future 
drug use.). 


As Eric and Art noted, in both cases the 
court ruled that the EEOC had not pre- 
sented credible evidence of adverse im- 
pact. The Kaplan decision has already 
been appealed; EEOC is considering an 
appeal of the judge’s decision in Free- 
man. The issues in these two cases both 
carry important lessons for l-O psycholo- 
gists working in employment litigation. 


In Kaplan, the organization claimed that 
it did not know or record information 
about the race of its applicants, which 
would make it difficult to hold them li- 
able for using employment practices 
that had adverse impact. EEOC consid- 
ered a number of strategies for recover- 
ing this information, and determined 
that information could be obtained from 
various Departments of Motor Vehicles 
that would enable them to determine 
the race of applicants. Some states re- 
cord race, but most provided drivers 
license photos. Panels of behavioral sci- 
entists with experience working in multi- 
racial contexts viewed photos, and strin- 
gent criteria were set to accept their 
judgments as valid indicators of the race 
of applicants whose photos were 
viewed. The court rejected this proce- 


dure, noting that it has not been subject 
to scientific peer review and that the 
error rate could not be established. 

In their appeal of the Kaplan ruling, 
EEOC has presented an extensive review 
of research showing that even when 
race identification via pictures is made 
purposefully difficult (e.g., when pic- 
tures are altered using photo morphing 
software or when subjects are chosen 
who have mixed heritage), error rates 
are very low, and that the procedures 
used are more rigorous than those ac- 
cepted by other courts. However, this 
judge’s ruling does carry an important 
lesson. Even if a proposition seems on 
the face of it to be obvious, strong evi- 
dence is better than a strong logical ar- 
gument. Here, the proposition that we 
cannot identify race by looking at a pic- 
ture seems on the face of it wrong (ask 
yourself how you know that John Elway 
is white and that Lawrence Taylor is 
black), but EEOC did not present com- 
pelling evidence for the validity of their 
procedures in their initial filings. 


In Freeman, the organization complied 
with discovery, but presented their data 
files in piecemeal fashion. It is not clear 
if they did this purposefully, but a good 
lawyer would certainly advise them that 
it is not their job and is not in their inter- 
est to make the EEOC’s task of reassem- 
bling the data provided into a coherent 
whole an easy one. In Freeman, the 
court concluded that EEOC had not been 


October 2013 Volume 51 Issue 2 


sions of the organization. The subset of 
data that was reliable and uncontested 
was not sufficiently large or representa- 
tive, and the data that represented the 
entire organization and time period was 
not sufficiently reliable to establish ad- 
verse impact. Here, the lesson seems to 
be that enforcement agencies and the 
experts who work with them may have 
to deploy greater forethought and preci- 
sion in framing discovery requests and 
to be in a position to deploy money and 
resources in increasing orders of magni- 
tude to make sense of the data they re- 
ceive. 


Stay tuned everyone. It will be interest- 
ing to see if an appeals court agrees with 
Kevin’s perspective on these and other 
issues. 
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“Big Data” Technologies: 
Problem or Solution? 


“Data is not information, information is not knowl- 
edge, knowledge is not understanding, understanding 
is not wisdom.” - Clifford Stoll 


By now, you have probably heard about the new “big 
data” trend and seen a plethora of articles that discuss 
the topic. To most practitioners and researchers within 
the field of industrial-organizational (I-O) psychology, big 
data isn’t new. Quite the contrary: I-O psychologists 
have been leveraging large amounts data to predict hu- 
man behavior and make organizational decisions for 
decades (Putka, 2013). In fact, |-O psychologists have 
long understood that “big data” can improve training 
practices, help track performance over time, provide a 
basis for new recruitment techniques, and streamline 
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selection and hiring practices and much 
more. However, what is new is the realiza- 
tion that there is a nearly constant imbal- 
ance between how much data we are able 
to collect and how quickly and appropri- 
ately we can make sense of the data, says 
Mike Hruska, CEO of Problem Solutions. In 
addition, there are new technologies that 
are changing the abundance of data being 
collected, availability of data, and data in- 
teroperability, thus increasing the number 
of ways in which we can use data to im- 
prove workplace practices. 


Even though big data may not be new to 
l-O psychologists or other related fields, 
we all still have much to learn and gain 
from the immense amount of data avail- 
able and new technologies that are provid- 
ing access and an ability to handle these 
data. Our goal for this column is to expose 
a few of the new technologies and the 
benefits they bring to areas such as train- 
ing, recruitment, and selection as well as 
some of the risks these new technologies 
introduce. We will briefly discuss ways |-O 
psychologists can manage big data, lever- 
age these technologies to move forward, 
help organizations address the risks, and 
support the development of evidence- 
based solutions or interventions. 


Big Data Opens New Frontiers in 
Practice and Research 


“Big data is most simply a lot of data. It 
could be defined by the volume or by 


the potential associations within the 
data,” says Mike Hruska, and it is quickly 
accruing due to new technologies that 
allow the collection, storage, and analy- 
sis of data in new ways that were not 
previously available to researchers. Big 
data analytics is not only opening new 
frontiers to inform organizational deci- 
sions, but it is serving as the foundation 
for state-of-of-the-art interventions. 


Big Data Allows for Adaptive and 
Individualized Training 

U.S. organizations spent approximately 
$156.2 billion on employee learning and 
development in 2011 with an increasing 
amount spent on technology such as 
mobile learning, virtual collaborative 
workspaces, and distributed simulations 
(ASTD, 2012). Such big data technologies 
include ones that allow for adaptive 
training or accelerated learning to take 
place. In other words, these technolo- 
gies are personalizing training by select- 
ing an appropriate training event or 
changing the content within the event 
based on the learners’ competence level 
or other characteristics. The technolo- 
gies that tailor or adapt the training ex- 
periences include but are not limited to 
intelligent tutoring systems or computer 
-based tutoring systems. Within an 
event, effective solutions tailor feed- 
back, provide opportunities for reflec- 
tion, and change the content, direction, 
pace, and challenge level of instruction 
to optimize learning (e.g., acquisition of 
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knowledge or skills). Most notably, they 
select optimal instructional strategies to 
meet the specific learning needs of indi- 
viduals or teams (Sottilare, Brawner, 
Goldberg, & Holden, 2012). Whether the 
event or training content is being 
adapted, the goal is to maintain the op- 
timal level of challenge for trainees, pro- 
vide support, and correct errors, which 
can all lead to greater training efficiency 
(Durlach & Ray, 2011). 


Other technologies are being designed 
to capture large amounts of data about 
the learner and their experiences in or- 
der to describe what is happening in any 
given situation or training event (formal 
or informal) and collect data at various 
levels (e.g., individual, team, organiza- 
tional). One example is the Learning Re- 
cord Store (LRS), developed through ini- 
tiatives at the Advanced Distributed 
Learning (ADL) Co-Lab, which is a stor- 
age system for user activity (ADL, 
2013a). In addition, ADL along with the 
Department of Defense is also develop- 
ing a new online learning standard 
called the Experience API (xAPI) that 
gives learners, instructional developers, 
and instructors the opportunity to track 
diverse types and modalities of experi- 
ences and access data that far exceeds 
the current capabilities (ADL, 2013c). In 
conjunction with the learning technol- 
ogy, XAPI will allow the community to 
track within traditional and nontradi- 
tional environments that were other- 
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wise not able to be captured by previous 
standards such as SCORM (ADL, 2013b). 
Other technologies such as learning 
management systems (LMS) are also 
being enhanced in order to track learner 
data that might occur in an informal 
training environment such as mobile 
applications, game-based learning, and 
virtual environments. 


These technologies are just a few of 
many efforts that will afford instructors 
and organizations the ability to collect 
activity across a variety of systems ena- 
bling virtually any other system to report 
who did what, when, and in what con- 
text. These are huge advancements that 
are pushing the bounds of how we cap- 
ture and analyze associated data of 
trainee performance within a training 
event or other experiential learning op- 
portunities that do not happen within 
the walls of a formal classroom. For ex- 
ample, organizations will be able to col- 
lect data on current books or articles 
that a learner might be reading, confer- 
ences they attend, virtual world interac- 
tions, and much more. As you might sus- 
pect, this is moving organizations ina 
direction of capturing a significant 
amount of data, which allows them to 
view learning paths that people take 
through the mapping of formal, infor- 
mal, and experiential learning data. Take 
for example a 10,000 person organiza- 
tion that begins tracking 50 things per 
day per user; that’s about 18.2 million 


data points per year! Furthermore, the 
collection of such data allows these sys- 
tems to support point-of-need training 
in environments where human tutors 
are either unavailable or impractical. 


Human Resource Professionals Are 
Applying Real-Time Utilizations of 

Big Data 

Based on current market trends, it is likely 
that organizations will continue to invest 
in big data technologies that support re- 
cruiting and hiring practices as well. Re- 
cent reports show that less than 20% of 
human resource (HR) professionals, ac- 
cording to SHL’s Global Assessment 
Trends Report, are satisfied with their 
current technology systems’ ability to 
manage their talent data. Another survey, 
conducted by CareerBuilder, indicated 
that 12% of the HR professionals planned 
to use big data management and inter- 
pretation within the following 6 months 
to improve hiring and recruiting efforts. 


One new company, Gild, has developed 
new big data software for recruitment 
and hiring purposes (Ritchel, 2013). This 
technology evaluates potential candi- 
dates for engineering or programming 
positions by analyzing their actual code 
from virtual communities such as GitHub 
or BitBucket, where they spend time de- 
veloping software and code. In addition 
to analyzing their coding skills, this new 
technology also analyzes the candidate’s 
professional knowledge and then creates 


a score for each candidate, providing 
companies with an assessment of the 
candidate’s talent (Ritchel, 2013). Other 
technologies are using big data and ana- 
lytics, and integrating them directly into 
the intervention. In other words, big data 
analytics can apply real-time utilizations 
of big data and the decisions rules de- 
rived from the analytics. For example, 
some new recruiting technologies use 
search engine and social media data to 
directly suggest jobs to potential recruits 
(Kutik, 2013). You may have noticed, for 
instance, that LinkedIn provides job sug- 
gestions based on your interests and 
skills. These technologies can also keep 
track of where the best sources to recruit 
candidates are by tracking the number of 
qualified applicants, the number of appli- 
cants interviewed, and also the number 
that were hired. 


As you can see, there are many new big 
data technologies evolving and playing a 
larger role in the way organizations are 
recruiting, hiring, training, and managing 
their employees. l-O psychologists need to 
be aware of these technologies and help 
organization leverage them appropriately. 


With Big Data Opportunity 
Comes Big Risk 


Although there are many potential 
benefits of leveraging big data technolo- 
gies, there are still many risks and prob- 
lems that can result if the data are not 
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managed properly. Applications of big 
data must be guided by clear objectives 
and an understanding of organizational 
theories that drive data analysis meth- 
ods. The potential risks stemming from 
careless, uninformed use, or even 
abuse, of big data and analytics may 
come in many forms. Below are just a 
few examples of these risks and issues. 


Investment in Big Data Can Lead to 
Financial Loss 

Big data can increase efficiency and re- 
duce the cost of programs if leveraged 
correctly, but it can also have poor return 
on investment by unnecessarily increasing 
the costs of collecting and managing the 
data. Organizations need to determine if 
big data initiatives add value above and 
beyond a more traditional and less re- 
source-demanding alternative. In other 
words, they need to determine if the gain 
from using big data technologies will jus- 
tify the investment. Successful organiza- 
tions do not adopt a methodology simply 
because it is accessible or fashionable. 
They do so because it adds value. 


Failure to Deeply Understand the Data 
Could Lead to Wrong Conclusions 
“There’s collecting and aggregating data 
and then there is understanding the re- 
sults. That is where the disconnect is,” 
says Dr. Theodore Hayes, personnel re- 
search psychologist of the Assessment & 
Evaluation Branch of U.S. Office of Per- 
sonnel Management. Uninformed users 
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of big data applications believe that as 
long as the data volume is big, the veloc- 
ity is fast, the source is novice, and the 
analytics are advanced, then “big data” 
will do its own magic. Some users also 
believe that the utility of big data comes 
from simply fishing around in the hope 
of finding relationships between any 
variables and that theory or carefully 
planning analysis is irrelevant. Other big 
data enthusiasts even go as far to sug- 
gest that researchers may need to stop 
worrying about the underlying cause of 
the phenomena and focus instead on 
that fact that it exists and learn how to 
manage it (Mayer-Schonberger & Cuk- 
ier, 2013). 


However, “big data is still imperfect 
data,” says Dr. Theodore Hayes, and just 
because the data are big, diverse, and 
pervasive, it does not make it a source 
of all relevant information. Simply put, 
effective organizational interventions 
should be based on sound theory and 
empirical evidence. Psychological and 
organizational theories can improve effi- 
ciency and effectiveness in data explora- 
tion by zooming in on the important as- 
pects, providing a comprehensive per- 
spective in the search of predictive and 
explanatory variables. This ensures that 
the data are being interpreted in a sensi- 
ble manner and that development of 
any solutions are done so by uncovering 
the true relations at the construct level 
and not based on spurious associations. 


Uninformed Analysis Can Lead to 
Violation of Fair Treatment 

If organizations use the wrong data or 
analytics, it can lead to the wrong con- 
clusions or a wrong intervention, which 
could result in significant issues. Not to 
mention potential lawsuits. These risks 
can even lead to unintended conse- 
quences such as unfair treatment. De- 
velopers and users of organizational in- 
terventions using big data need to be 
cognizant of the impact they have on 
individuals. If the interventions can lead 
to the change of the individuals’ employ- 
ment status (e.g., whether being hired, 
whether getting a promotion, whether 
getting terminated, etc.), then the proc- 
ess leading to the decisions will still be 
subjected to regulatory scrutiny. “Any 
process that has a consequential nature 
for someone's employment status rela- 
tive to an organization is subject to regu- 
lation,” says Dr. Hayes. In selection ap- 
plications, for example, a careless use of 
predictive analytics may lead to the use 
of race, gender, and age variables (or 
close proxies of them) as part of the se- 
lection decision, which is not defensible 
and could potentially lead to a lawsuit. 
An understanding of psychological 
measurement and employment law is 
vital in this case. 


Careless Use of Data Can Lead to an 
Increase in Privacy Concerns 

Though many organizations nowadays 
want to project a vigorous, tech-savvy 


image, misuse of big data or the failure 
to implement a proper communication 
plan may damage an organization’s im- 
age or relationship with its employees. 
Within an organization, big data driven 
interventions using untraditional data 
collection schemes (e.g., email commu- 
nication trails, electronic monitoring), 
though well-intended and legal, may 
backfire if employees or job seekers feel 
that there is an invasion of privacy, a 
lack of trust, or a lack of transparency. 
For example, one study found that appli- 
cants who believed they were being re- 
motely proctored during an assessment 
negatively reacted to the testing tech- 
nology (Karim, Kaminsky, & Behrend, 
2013). Furthermore, according to a re- 
cent Pew Report, 57% of individuals us- 
ing mobile applications will remove or 
simply not download an app due to the 
perception that the app is collecting and 
using their personal information. 


How Can I-O Psychologists Help? 


Staying ahead of the big data curve re- 
quires that organizations have technol- 
ogy systems to support the collection, 
storage, and analysis of this data but 
more importantly that they have the 
appropriate human talent to interpret 
the use of this data (Mcllvaine, 2013; 
Putka, 2013). Quite frankly, organiza- 
tions need help making sense of what to 
do with all of the data and determining 
which big data approach is even neces- 
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sary (Mcllvaine, 2013). Who better than 
l-O psychologists to help handle data 
and serve as advisors to organizations 
about how best to collect, analyze, and 
use big data to drive organizational deci- 
sions (Facteau, Mitchel, Manzullo, Car- 
lisle, & Burke, 2013; Putka, 2013). 


Whether it is |-O psychologists or others 
in related fields, the fact is we need to 
ensure that someone with training in 
psychometric principles, research theory 
and design, principles of organizational 
phenomena, organizational develop- 
ment, and interventions is assisting with 
these big data processes. This expertise 
is key to good data analysis and inter- 
pretation along with the development of 
appropriate interventions (Facteau et 
al., 2013; Putka, 2013). 


There are many big data areas that I-O 
psychologists and others with similar back- 
grounds can assist with and facilitate best 
practices. Overall, these areas include: 


- Leveraging data and analytics to in- 
form and develop solutions that sat- 
isfy organizational issues. 

- Facilitating the proper use of big data 
by providing substantive theories. 

- Defining and evaluating the return 
on investment for technological so- 
lutions based on big data. 

- Providing methodological guidance 
on data collection, management, 
and analysis. 
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- Ensuring data are representative of 
targeted populations, inclusive of 
critical predictor and criterion con- 
structs, and are subjected to less 
errors or “noise.” 

- Applying measurement theories to 
facilitate the design of big data driven 
assessments and evaluate the validity 
of the outcomes they produce. 

- Assessing and addressing risks stem- 
ming from unintended conse- 
quences of big data applications. 

- Document and report the effective 
use of big data applications to cre- 
ate a model for the future. 


In short, I-O psychologists can help im- 
prove big data applications by ensuring 
organizations are collecting data ina 
more relevant, efficient, effective, and 
defensible way. As we know, technology 
is continually playing a bigger role and 
impacting our daily work; therefore, we 
must continue to stay ahead of the curve 
so we can know how best to use and lev- 
erage them appropriately. This is espe- 
cially true for big data technologies. It is 
critical for |-O psychologists to stay up to 
date with current efforts and solutions 
that are changing the way organizations 
collect data so we can be there through- 
out the whole process to help inform 
practice. As Putka (2013) put it, big data is 
a “golden marketing opportunity” for the 
field of l-O psychology! As a sneak pre- 
view, our next article will focus on how 
each of you can create greater visibility 


and personal brand as an I-O psychologist 
by leveraging these cutting-edge tech- 
nologies and social media tools. 


Follow us on Twitter @themodernapp 
and tell us how you are using #bigdata! 
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Organizational An Interview With 
Neuroscience Professor Daniel Simons 


Our journey through the meta- 
phorical construction site that 
is organizational neuroscience 
(ON) begins with an exciting 
interview with Daniel Simons. 
Most of us know him for his 
famous experiments about in- 
attentional blindness that 
shocked those of us who think of ourselves as percep- 
tive. If the prior sentence sounded nonsensical, then 
watch Daniel Simons’ video here before continuing to 
read. As we mentioned in our first issue, we’re taking a 
“big tent” approach to ON that embraces a variety of 
methods and perspectives on our attitudes and behav- 
iors, and that’s exactly what Daniel Simons’s work 
aims to do. In this issue, we discuss how we can fail to 
notice things in plain sight and how our intuitions can 
influence data and prediction. 


We would far exceed our word limit if we were to spell 
out all of Daniel Simons’s accomplishments as a psy- 
chologist, so what follows is a very brief summary. Dr. 
Simons is a professor in the Departments of Psychology, 
Advertising, and Business Administration at the Univer- 
sity of Illinois. He received a BA in psychology and cogni- 
tive science from Carleton College and a PhD in experi- 
mental psychology from Cornell University. His research 
has been funded by the Alfred P. Sloan Foundation, the 
National Science Foundation, the National Institutes of 
Health, and General Motors. In 2003, he received the 
Distinguished Scientific Award for Early Career Contribu- 
tion to Psychology from the American Psychological As- 
sociation. In addition to over 50 peer-reviewed publica- 
tions, a book, numerous general press articles, keynotes, 


North Carolina State 
University 
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and workshops, Dr. Simons has earned 
several awards for his pedagogical work 
at Cornell, Harvard, and the University of 
Illinois. 


During the interview, we talk about Dr. 
Simons’ work researching inattentional 
blindness, change blindness, and mecha- 
nisms that explain why some people see 
gorillas and others fail to notice what we 
previously thought would be obvious. 


What research projects are you 
currently conducting? 

In addition to documenting failures of 
awareness and demonstrating failures of 
awareness, my work explores the 
mechanisms of perception, attention, 
and awareness. Demonstrations are use- 
ful because they bring home the point in 
a powerful way—they illustrate that an 
effect applies to many people, but it’s 
necessary to study such effects more sys- 
tematically in a lab if you want to under- 
stand the mechanisms; there are only so 
many things you can do by putting peo- 
ple in a gorilla suit. 


If there’s one unifying theme for my work 
over the past 5 years or so, it’s that our 
intuitions about how our minds work 
don’t always match the reality of how our 
minds work. I’m interested in that mis- 
match, why it matters, and when it mat- 
ters. This isn’t a new idea, of course, but 
it’s an interesting one. 


One of my recent studies (with coauthor 
Christopher Chabris) looks at how people 
think memory works. People hold really 
strong beliefs about how memory 
works—when it’s accurate and when it’s 
not—and a lot of those intuitions are 
wrong. Many are strikingly different from 
what we’ve known for 30 or 40 years 
from research on memory. For example, 
many people think memory works like a 
video camera. They know that’s not true 
for things like remembering a phone 
number or where you parked your car, 
but for things that are personally impor- 
tant, people feel like they’ve got a video 
record of what they experienced. People 
think that they remember important stuff 
vividly. That’s because when they recall 
it, it feels vivid, and they rarely check to 
see if they’re right! It’s an intuitive idea 
that we rarely question. In Harry Potter, 
Dumbledore extracts memories from his 
head and then reviews them. The idea is 
so intuitive that the implausibility doesn’t 
bother us. I’m interested in a variety of 
intuitions like this one, cases in which we 
think we understand how our mind 
works but don’t. 


Another line of research explores individ- 
ual differences in attention and aware- 
ness. With the gorilla video, about half of 
the people notice it and the other half 
don’t. The question | get most frequently 
is, “What is it about that 50% of people 
who notice it—are they somehow differ- 
ent from those who don’t?” The assump- 
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tion is that there must be something dif- 
ferent about them that leads them to no- 
tice. But are there really noticers—people 
who are more likely to see these things? 
Are there missers—people who are oblivi- 
ous? It’s remarkable how poorly we can 
predict who will notice. People who are 
really good at tracking things moving 
around on a display are no more likely to 
notice something unexpected. Working 
memory capacity doesn’t seem to have 
much if any effect. We’ve been exploring 
these types of individual differences for a 
while, and we really haven’t found any 
cognitive abilities that consistently predict 
whether someone will notice something 
unexpected. Cognitive abilities like work- 
ing memory capacity can predict how well 
you'll be able to stay on task and ignore 
distractors that you know about and are 
trying to ignore. It doesn’t predict how 
likely you are to notice something that you 
weren’t expecting in the first place. There 
might be some individual differences in 
personality that predict noticing, such as 
how inclined you are to remain focused on 
doing the task. But, even those predictors 
aren't too reliable. If you can get people to 
try harder on the task or if you make the 
task harder, more people will miss some- 
thing unexpected. But, it’s much harder to 
predict which people will notice. 


All of those sound like conscious meas- 
ures, but what about the unconscious 
mind and processes that you’d think 
would allow you to notice the unex- 
pected? 
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I’m pretty skeptical about claims of un- 
conscious processing. | don’t think 
there’s particularly compelling evidence 
for rich, meaningful processing happen- 
ing outside of awareness. Of course the 
light from the gorilla hits your retina and 
is processed at some level without 
awareness, but | don’t think that you 
process the gorilla as a gorilla without 
awareness. It’s remarkably hard to show 
that something was processed entirely 
without awareness, and the inatten- 
tional blindness task is not a great way 
to do that. Just because people don’t 
report something doesn’t mean they 
weren't aware of it at some level. 
Maybe people processed the gorilla as 
“stuff” but it got grouped with the team 
in black so they didn’t process it any 
more than that. Maybe people actually 
saw the gorilla, but were hesitant to re- 
port it because it’s so strange. So it can 
be hard to separate the question of 
whether or not they reported it from the 
question of whether or not they proc- 


essed it at all. What’s necessary to claim 


that something is implicit is not a simple 
question. 


What sort of basic behavioral measures 
are you using to study these different 
phenomena? 

My feeling is that methods are a means 
to an end. We want to make sure that 
what we’re studying has real-world rele- 
vance and that we can measure it sys- 
tematically. So in some studies we'll 


show videos and collect self-report data. 
In other studies, we’ll use response time 
measures over many trials and get a 
range for performance. We use eye 
tracking to gauge where people are 
looking across several displays to get a 
sense of what draws attention by using 


the eyes as a proxy for attention. | really 
like converging methods. 


What do you think are the most impor- 
tant lessons from your findings about 
attention and memory for people in 
organizational settings—both from a 
researcher’s perspective and a practi- 
tioner’s perspective? 

One biggie is don’t trust focus groups. | 
think there’s a real danger in trusting 
people’s introspections, especially if you 
are asking why they like something or, 
really, anything that requires them to 
have some sort of insight about how 
their mind is functioning and what the 
mechanisms are—that’s likely to be 
flawed because our intuitions about the 
mechanisms of our mind often are 
based on incomplete information. | think 
that’s probably the most consistent mis- 
take I’ve encountered: When | talk to 
organizations that are trying to evaluate 
whether their employees are content, 
for example, they’ll just ask people, 
“What makes you happy?” That’s okay, 
but when they then ask people to ex- 
plain the reasons why and base organ- 
izational changes on those introspec- 
tions, they’re headed for trouble. People 


often have no idea why they like what 
they do, but they’ll give you a reason 
anyway. 


The cognitive biases that affect how we 
make decisions also creep into manage- 
rial decisions like performance and hir- 
ing. And that’s not surprising—those 
biases are part of human nature and are 
completely reasonable based on the evi- 
dence that’s available to us. It’s just that 
the evidence itself is misleading. If 
you’re a manager, and you’re evaluating 
someone’s performance, all you have 
are the little snippets in front of you 
from when you evaluated their perform- 
ance. You don’t have the broader con- 
text, you don’t have the comparison to 
what happens when you weren’t ob- 
serving them. What’s striking is how of- 
ten we don’t notice or think about the 
evidence we’re missing. If | had to point 
at one thing that | think is probably com- 
mon in a lot of organizations, it is the 
assumption that you understand things 
better than you actually do. There’s 
something we call the illusion of knowl- 
edge that is a tendency to think you un- 
derstand something much more deeply 
than you actually do. My colleague Leon 
Rozenblit did work on this in which he 
asked people if they knew how common 
objects worked. For example, if you ask 
people if they know how a toilet works, 
most people are fairly confident that 
they do. If you then ask them what 
causes the water to leave the toilet 
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bowl, or how the tank empties and re- 
fills, or how the bowl refills, most people 
have no idea. They can guess, but they 
don’t actually know the answers even 
though they thought they did because 
they know how to work a toilet. Know- 
ing how to use something makes people 
feel they understand it at a deeper level. 
Leon calls this sort of mistaken belief an 
illusion of explanatory depth. It plays out 
when you have a manager trying to 
evaluate an employee. They probably 
have information about what that per- 
son has done but no information about 
that person’s motives or that person’s 
capacities other than what they’ve pro- 
duced. If you have somebody to whom 
you’re giving boring assignments, and 
they’re completing those assignments, 
you might conclude that that’s what 
they’re good at without realizing they'd 
be great at revamping the entire strat- 
egy for your business. So you make 
jumps from the limited information that 
you have and, although reasonable, 
those jumps can be really off. 


Are there any final points or conclusions 
you'd like to leave with the TIP readers? 
The main thing is that while some intui- 
tions are really accurate, others can be 
flawed in critical ways. If you ask some- 


one what they’re preferences are, they'll 
be able to tell you. People know what 
types of ice cream they like or that they 
find someone attractive. If you ask them 
why they like that ice cream or why the 
find someone attractive, then you’ve got 
a problem. Knowing when your intui- 
tions are most likely to be right is the 
key to getting good information as op- 
posed to misleading information. 


Conclusions 


A hearty “thank you” to Daniel Simons 
for his insightful answers that remind us 
to consider our intuitions when soliciting 
information in organizations. We think 
that these points have important impli- 
cations for both ourselves as well as the 
participants in our studies. Thinking 
about how our brains process changes in 
our environments has relevance for per- 
formance ratings, training programs, 
and managerial decision making to 
name a few. The variety of approaches 
he uses to study how our minds work 
makes his work an excellent model to 
draw from and emulate as we build ON. 
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THE SCIENCE OF PERSONALITY 


Practitioners’ Enhanced Visibility Through Partnerships: 
Forum Linking I-O to Other Professions 
and Organizations 


A strategic emphasis for SIOP is making our research and 
practice more visible and promoting I-O psychology out- 
side our membership. We are experts at producing re- 
search and applying principles of psychology to work; 
many of us are less expert on publicizing the value, out- 
comes, and implications of what we do to consumers of 
our work. As noted (Reynolds, 2013), efforts are under- 
way to brand SIOP to advance our goal of being the 
“visible and trusted authority on workplace psychology.” 
Having a consistent and compelling brand will help con- 
vey the content and context in which we work. 


How do we leverage enhanced branding to fully realize 
the vision of increasing the extent to which our expertise 
is utilized? Making inroads with partner organizations, 
organizations with similar goals for improving the work- 
place but from different approaches and/or perspectives, 
can lead to interesting opportunities for multidisciplinary 
research and practice, and enhanced visibility through 
groups that have substantial reach and connections with 
Tracy Kantrowitz potential end users of our work. In this column, | review 

SHL ways in which the Professional Practice Committee is 
building bridges with organizations that can serve as ve- 
hicles for publicizing and disseminating our work. | also 
pose questions to several I-Os working internally at such 
organizations who can speak to the awareness and em- 
beddedness of I-O in their organizations and ways in 
which I-O psychology can realize its role as a visible and 
trusted authority through partner organizations. 


Making Inroads With Partner Organizations 


Partner organizations can include professional organiza- 
tions, fellow APA divisions, multidisciplinary research 
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centers, and government units that repre- 
sent professions and specialties that 
share a focus on “work” with I-O psychol- 
ogy. These organizations (e.g., Society for 
Human Resources Management, SHRM; 
Equal Opportunity Employment Commis- 
sion, EEOC) can help advocate for the 
practice of l-O psychology as distinct from 
other practices and can help make what 
we do obvious to groups they represent. 
As a committee, Professional Practice 
strives to forge relationships with external 
organizations that can help serve this pur- 
pose. Current examples of this include: 


e The SIOP/SHRM Science of HR Series: 
This evidence-based series is designed 
for the more than 250,000 members 
of SHRM. This includes a set of white 
papers written by SIOP members on 
topics chosen by SHRM representing 
areas of interest to HR professionals. 
A recent extension of this collabora- 
tion is the creation of a series of “Top- 
10” lists of key research findings that 
have impacted I-O practice. 

SIOP Task Force on Contemporary 
Selection Practices Recommendations 
to EEOC: This task force of experts has 
been assembled to summarize the 
state of research and practice on top- 
ics of relevance to EEOC. This infor- 
mation is likely to culminate in a se- 
ries of best practice papers to be 
housed on the EEOC website. 

Liaising with the APA Center for Or- 
ganizational Excellence’s Psychologi- 


cally Healthy Workplace program 
and other health and well-being or- 
ganizations: The Professional Prac- 
tice committee is currently working 
with APA to promote SIOP’s mission 
and extend our influence to the 
broader APA community. In addi- 
tion, partnerships are being forged 
with other organizations that have 
the reach and influence to promote 
research and practice conducted by 
l-Os related to occupational/ 
employee health and well-being. 


l-Os on the Inside of Outside 
Organizations 


To highlight the role that partner organi- 
zations can play in the visibility of I-O psy- 
chology, | posed several questions to SIOP 
members who work in such organizations. 
Thanks to Alex Alonso and Jim Kurtessis 
(Society for Human Resources Manage- 
ment), Cristina Banks (Lamorinda Con- 
sulting and Berkeley Center for Healthy 
Workplaces), and Rich Tonowski (Equal 
Employment Opportunity Commission) 
for their experience and insights, shared 
below in summary form. Collectively, this 
panel works in or with government, law, 
and human resources, fields with obvious 
ties to areas of l-O practice. 


You are the only or one of few I-O psy- 
chologists in your organization. For what 
topics do your colleagues view you as an 
expert as a result of your training/ 
background in I-O? Put another way, 
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what kind of work do your colleagues 
think you do? 

Perhaps most importantly, the panel un- 
derscored that I-Os assume that profes- 
sionals from other disciplines aren’t 
aware of I-O, so they spend a substantial 
amount of time informing others who are 
commonly in the dark. Once understood, 
people “get it” and understand that our 
remit is measuring and describing work 
and what people do on the job, and that 
involves traditional areas of I-O practice, 
including job analysis, assessment, com- 
petency modeling, validation, litigation 
support, survey research, and statistical 
analysis. When people know us, it’s often 
because organizations have a problem 
which requires our expertise and they 
need help describing and measuring 
work. In this regard, I-O is inextricably 
linked to solving the problem, whether 
it’s providing the necessary job analytic 
information to help attorneys win cases 
or evaluating and defending the use of an 
assessment in a discrimination case. In 
cases where I-Os work alongside other 
disciplines (economics, law, statistics, so- 
ciology) or even other areas of psychol- 
ogy, these disciplines understand that l- 
Os are experts in unique and specific ar- 
eas and that anything involving “work” as 
the context requires l-O expertise to knit 
together diverse elements such as work 
design, company culture, and employee 
rewards and performance. 
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How has I-O psychology been linked to 
“mission critical” objectives of your or- 
ganization? 

The panel indicated that I-O research 
and practice are tightly linked to organ- 
izational objectives, whether it’s embed- 
ded in SHRM’s goals and objectives (e.g., 
development of a competency model for 
HR professionals) or woven with the 
mission of an organization (e.g., work 
performed as part of litigation support 
for EEOC). Likewise, the panel under- 
scored a distinction between the extent 
to which I-O is linked to top level objec- 
tives and how it’s carried through an 
organization. For instance, one of the 
most prestigious awards at SHRM is the 
Michael R. Losey award (honoring life- 
time contributions in HR research), 
which has been presented to an I-O psy- 
chologist nearly every year of its exis- 
tence. In contrast, |-O psychology isn’t 
readily known or understood by the ma- 
jority of SHRM members, as evidenced 
by results of a survey conducted by 
SHRM and SIOP in 2012. Interestingly, 
however, the average HR professional 
almost definitely knows about goal set- 
ting theory, Kirkpatrick’s hierarchy of 
training outcomes, and characteristics of 
providing good feedback. They may not 
know these theories and concepts stem 
from I-O psychology or which research- 
ers developed or tested the theories, 
but this information has been filtered 
well to HR professionals and are consid- 
ered gold standards and not even just 
“best practice” for HR practice. 


In what ways has I-O research and prac- 
tice been communicated (directly or 
indirectly) to the “end users” of your 
organization? In what other ways can 
your organization serve as a vehicle for 
communicating research and practice 
conducted by I-Os? 

The panelists indicated that if we want to 
promote the widespread use of I-O exper- 
tise and better connect with end users 
who can take advantage of our research 
and services, we need to go where the 
people go: social media, trade magazines, 
popular press, educational webinars, and 
employer conferences. We spend a lot of 
time contributing to the profession by 
publishing in scientific journals so that 
peers can stay up to date with research 
findings. Citation indices show that some 
of the most impactful articles in our field 
are cited by hundreds of other authors. 
Although the journals allow us to “talk” to 
each other to learn from other experts 
and extend the body of research, we also 
need to be talking to the people who can 
take advantage of such research. Consider 
that the SHRM Research Organization has 
20,000 Twitter followers. Collaborating 
with SHRM and other HR analysts to point 
their members to mainstream articles 
written by l-Os could have tremendous 
impact in growing awareness of problems 
l-Os can solve and maximizing the extent 
to which our expertise is sought. 


A Shared Responsibility for 
Enhanced Visibility 


Enhanced branding has the potential for 
more clearly distilling and communicat- 
ing what our specialty is all about, but 
it’s clear that branding is just one suc- 
cess factor to fully realizing SIOP’s goal 
of becoming the visible and trusted au- 
thority on workplace psychology. Work 
underway by the Professional Practice 
Committee shows external organizations 
are interested in forming ties with SIOP 
to learn from our research and practice. 
Although we will continue to build for- 
mal relationships with partner organiza- 
tions, our value will only continue to be 
shown (or enhanced) if each of us, as 
members of SIOP, continues to hone our 
skills at providing demonstrable and ob- 
vious benefits of the work we do to our 
colleagues and friends in other disci- 
plines and organizations where I-O is 
relatively unknown. 


Identifying collaboration opportunities is 
only the first step in maximizing the po- 
tential for working with partner organi- 
zations. Whether it’s an official partner- 
ship designed by SIOP or the work we do 
every day with organizations, it is up to 
each of us to inextricably link our work 
to other fields and potential end users, 
frame our work in terms of what other 
professions value, and make our work 
and contributions obvious. 
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Academics’ Deciding Whether to Persist With 
Forum a Paper or Let it Die 


When | was in elementary school, one of my favorite 
types of books to read was “Choose Your Own Adven- 
ture” books. The books were written in such a way 
that, at various times throughout the story, the reader 
was asked to decide where the story should go. There 
was a magical feeling knowing that, as a child, | could 
impact the outcome of the story by choosing whether 
|, as the main character, would turn left and head 
down the creepy alley, go straight through a mysteri- 
ous red door at the end of the corridor, or turn right 
and venture into the forbidden woods. As a kid whose 
seemingly only decision points included what | would 
wear to school that day or who | would sit with at 
lunch, getting to make these “tough” decisions was 
exciting. 


Now, as an adult, | find that there are so many deci- 
sions | have to make that it can sometimes be exhaust- 
ing. In fact, | sometimes joke that | wish we had uni- 
forms for work so it would be one less decision I’d 
have to make each day. (And, for the record, I’d like 
Satoris S. Culbertson those uniforms to be scrubs because they look so in- 
Kansas State University credibly comfortable, like professional pajamas!) 
Maybe, in the spirit of “me-search research,” the phe- 
nomenon whereby some researchers tend to focus 
their work on issues that are personal in an attempt to 
gain a better understanding of themselves, it is this 
disdain for having to make decisions in my own life 
that has led to my most recent research interests in 
the area of judgment and decision making. 


One of the more recent studies that I've been working 
on in this area involves escalation of commitment, or 
the tendency to continue to invest resources in the 
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form of time, money, or effort toward 
unproductive or failing courses of action. 
As the authors of a recent meta-analysis 
on escalation of commitment wrote, 
"One of the most robust and costly deci- 
sion errors addressed in the organiza- 
tional sciences has been the proclivity 
for decision makers to maintain commit- 
ment to losing courses of action, even in 
the face of quite negative news" 
(Sleesman, Conlon, McNamara, & Miles, 
2012, p. 541). Yep. That sounds like me. 
Take for example the following letter 
from an editor: 


Dear Dr. Culbertson, 


| have now received two reviews of 
your manuscript. In addition to having 
two experts in the field read your 
work, | have also read your manuscript 
several times. Both reviewers had simi- 
lar comments, and my own thoughts 
mirror their points. | believe the re- 
viewers do a fine job of detailing their 
concerns, so | will not repeat them 
here. Suffice it to say that you we can- 
not accept your manuscript for publi- 
cation at this time nor will we be invit- 
ing a revision. Indeed, we strongly rec- 
ommend that you save future review- 
ers and editors the extreme misfortune 
of having to read such a pitiful at- 
tempt at research by never, ever sub- 
mitting it anywhere ever again. In 
fact, we urge you to burn all evidence 
that this rubbish ever existed and 


purge it from your thoughts forever. 
We thank you for the interest in the 
journal and hope you continue to con- 
sider us for future submissions (unless 
of course they are as bad as this one, 
in which case we ask that you pass us 
by or else we'll have to contact your 
doctoral granting institution and have 
your PhD revoked). 


Warm regards, 
Editor 


Okay, fine. You caught me. This isn't a real 
letter from a journal editor that I've re- 
ceived. But it's close. Come to think of it, | 
am pretty sure I've gotten letters that re- 
quested a resubmission that were almost 
as negative as this. Aren't those called 
"high risk" and meant to encourage us to 
work even harder on our revisions, to 
really impress the reviewers, especially 
that pesky Reviewer #2? That's just how 
the review process is, right? According to 
my mom, if it were easy, it wouldn't be 
worth it (R. Youngcourt, personal commu- 
nication, June 8, 1983). Presumably, then, 
when we get a rejection, we're supposed 
to persevere. We're supposed to keep on 
trying, revising and resubmitting, until the 
paper finds a home, right? Like the iconic 
image of the frog that is choking the stork 
while the stork is trying to swallow it, 
we're never ever supposed to give up! 
Wayne Gretzky reminded us that we miss 
100% of the shots we don't take. Fascinat- 
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ing. And, if I've learned anything from mo- 
tivational posters at the dentist's office, 
it's that success is measured by a willing- 
ness to keep trying! 


But wait. Yoda, renowned Jedi Master 
himself, said "Try not. Do, or do not. 
There is no try." A popular demotiva- 
tional poster suggests that we give up, 
because, at some point, hanging in there 
just makes you look like an even bigger 
loser. And W. C. Fields is quoted as say- 
ing, "If at first you don't succeed, try, try 
again. Then quit. There's no point in be- 
ing a damn fool about it." So, who am | to 
believe? Do I keep trying, like the "The 
Great One" (Gretzky) suggests, or do | 
throw in the towel as the comic genius 
(Fields) suggests, lest I look like a fool? Do 
| continue persisting with a paper, de- 
spite rejection (or multiple rejections) or 
do | cut my losses, let the paper die, and 
move on? If only | knew what Chuck Nor- 
ris would say on the matter... 


Well, | don't know what Chuck has to say 
about it. My guess is he wouldn't know 
what to say because he's never been re- 
jected from anything, ever. He does the 
rejecting. And he's too busy rubbing two 
ice cubes together to make a fire to be 
bothered with the question. So, because | 
can't get advice from Mr. Walker, Texas 
Ranger himself, | opted to ask the next 
best people (presented in alphabetical or- 
der): Bruce J. Avolio, Ph.D., Professor of 
Management, Mark Pigott Chair in Busi- 
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ness Strategic Leadership, and Executive 
Director of the Foster Center for Leader- 
ship at the University of Washington; 
Mindy Bergman, associate professor in the 
Department of Psychology at Texas A&M 
University; Lisa Finkelstein, professor of 
Psychology at Northern Illinois University; 
Scott Highhouse, professor and Ohio Emi- 
nent Scholar in the Department of Psychol- 
ogy at Bowling Green State University; and 
Gary P. Latham, Secretary of State Profes- 
sor of Organizational Effectiveness and 
Professor of Organizational Behaviour and 
HR Management at the University of To- 
ronto. | thank each of these individuals for 
their insights on this issue. 


Is Letting a Paper Die Even an Option? 


| first asked my panel of experts whether 
they have ever let a paper die. The short 
answer is that yes, it seems that abandon- 
ing a paper is the decision several have 
made at one point or another. This defi- 
nitely wasn't the norm, however, and was 
usually done after careful consideration 
and/or numerous failed attempts. As 
Highhouse noted, "I definitely have let 
papers die. I am not a journal snob, so it 
wasn't because | couldn't get it into an 'A' 
journal. It was usually because | realized 
the reviewers were right." A similar senti- 
ment was voiced by Avolio, who noted 
that papers of his that have died were 
ones that spent "several years in reviews, 
went thru A, B, and C level journals, and 
got similar critiques." 


Reasons to Let a Paper Die 


So, what makes a paper more likely to be 
abandoned, destined for the ol' research 
file drawer, if you will? According to Berg- 
man, "If | cannot see a future for the pa- 
per—if | step back and put my ‘reviewer's 
eye' on it and see fatal flaws that addi- 
tional data cannot resolve, it dies." So, 
what are these fatal flaws? Avolio noted 
that a paper may be more or less doomed 
when it has such things as "a weak con- 
ceptual framing, methodological deficien- 
cies that limit its contribution, for exam- 
ple, testing a longitudinal process with a 
cross-sectional design, relatively small 
and unique sample, single sources, [or] 
not very good criterion measures." High- 
house similarly noted that methodological 
and sample-related issues were likely 
problems that wouldn't be overcome. As 
he noted, “Unfortunately, experiments 
with naive participants are doomed to 
failure. I am hoping that the availability of 
real people on Mturk will reverse that 
situation (insert sarcasm). It is very trendy 
now to have repeated administration of 
measures, so | guess you're doomed with- 
out it." 


As Highhouse noted, "reviewers are 
pretty good at pointing out weaknesses 
(more sarcasm), but seriously you can get 
a pretty good idea if your study is fatally 
flawed." Of course, you don't have to wait 
for reviewers to point out a study's flaws. 
Latham relayed invaluable advice he re- 


ceived from Ed Fleishman in 1974. "He 
told me to always send my manuscripts to 
my "enemies" (he was using hyperbole to 
make his point) because they would 
gladly point out its shortcomings while my 
friends would tell me how good it is. | 
have followed that advice religiously be- 
fore | submit a paper to a journal. | ask 
people to please, please critique every- 
thing from experimental design to gram- 
mar." Of course, Latham also noted that 
we can be our own critics as well, re- 
counting the story of the first time he 
met Henry Tosi, at a party Ken Wexley 
held in honor of Latham's passing the oral 
defense of his dissertation. Tosi told 
Latham, "Kid, always critique your own 
work. It will drive your enemies nuts and 
you will likely get another publication out 
of it." Perhaps it is because of these nug- 
gets of advice that, since their first paper 
was published in 1975, Latham and Ed 
Locke have never had a manuscript they 
coauthored that has failed to get pub- 
lished! 


Beyond methodological concerns, how- 
ever, sometimes it's the paper's likely 
contribution or the waning of personal 
interest. As Finkelstein noted, the death 
of papers has occurred for her "when 
there is just no movement on it for 
months and months, and there isn't 
enough there that would warrant the 
amount of work it would take." Indeed, 
it seems like this is what happens with 
many people and their dissertations. The 


October 2013 Volume 51 Issue 2 


mere thought of having to cut a lengthy 
dissertation down to size after spending 
so long getting it built up is just too 
daunting for some individuals. 


Reasons to Persist With a Paper 
Clearly, there are reasons a paper may 
be doomed. In these cases, perhaps W. 
C. Fields was right in that you're a damn 
fool if you persist too long. But what are 
some reasons to persist with a paper, 
despite numerous rejections? In what 
cases should you listen to all of motiva- 
tional quotes on Pinterest and refuse to 
give up? Is there a situation in which 
you should look at the paper, despite 
rejection after rejection, and say, "l'm 
never gonna give you up!"?" Well, ac- 
cording to my panel of experts, one of 
the biggest factors that will make them 
persist has do with the importance of 
the research question. Regarding this 
point, Highhouse noted that the biggest 
factor for him in terms of whether he we 
will persist or not is the message of the 
manuscript. If it's important enough, 
and he feels the data should be pub- 
lished, he will persist. Avolio similarly 
noted that he is willing to persist with a 
paper when he thinks it is something 
that "will push the literature in a new 
direction." Another issue that is rele- 
vant, of course, is whether the previ- 
ously mentioned flaws can be ad- 
dressed. As Bergman and Highhouse 
pointed out, sometimes additional data 
and/or another study will help to sal- 
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vage a seemingly doomed paper and 
make it more likely to be accepted 
somewhere. 


In terms of persistence, Latham recom- 
mends that you remember that publish- 
ing is about both substance and style. If 
a paper is getting rejected but is based 
on sound theory and there are no meth- 
odological flaws, it could be that you're 
simply not packaging it well. He suggests 
examining one's writing style to make 
sure clear, straightforward sentences 
are being used. As Fred Fiedler once told 
him, people should use "sentences that 
people would read and easily remember 
while watching television with children 
playing nearby." By working through 
some of the stylistic issues, persistence 
may pay off. 


Recommendations for Deciding Whether 
to Persist or Abandon a Paper 


| think it's fair to say that the decision of 
when to persist and when to cut one's 
losses isn't always clear. Although it is 
probably more common to be dismayed 
when a paper gets rejected, there are 
certainly times when a paper is accepted 
that we thought was going to be 
doomed. | hear statements on both 
sides after the SIOP conference accep- 
tance and rejection notices are sent out, 
and I'm sure l'Il hear similar ones this go 
around. | can almost hear them now: 
"Wow! I can't believe this paper didn't 


get in! It was golden! Now how am | 
supposed to get an authentic Hawaiian 
shirt to complete my ‘Shirts from All 50 
States' collection?" Or, on the flip side, 
"Wow! I can't believe this paper got in! 
We just threw some words together us- 
ing a random sentence generator with 
the hopes of getting something ac- 
cepted so that we could go to Hawaii. 
Whoo hoo... Honolulu here we come!" 


Given that it isn't always clear, what ad- 
vice do our panelists have with regard to 
persisting or dropping a paper? Avolio 
makes the following suggestion: "Like in 
finance, have a diversified portfolio 
based on risk assessment of your work. 
Don't persist to the exclusion of other 
possibilities." He continued by noting 
that "Science by its very nature is based 
ona high level of rejection, good sci- 
ence. So persisting is what we do to be 
successful." Bergman suggests the deci- 
sion be made on the basis of the previ- 
ously mentioned points (e.g., the fatal 
flaws) and also suggests that, if you con- 
tinue to keep abandoning papers, you 


conduct a “post mortem” to figure out 
why it keeps occurring, “so you can see 
how the choices you made led to the 
situation you’re in.” Then there's Finkel- 
stein's zen-like advice: "Think about how 
you think you would feel if you just let it 
go. Did you just feel lighter? Slightly 
calmer? That might be a sign." And, last 
but not least, there is Highhouse's sage 
advice: "Don't publish something you 
will be embarrassed about in 5 years." 
Hmm... | wonder if that includes TIP col- 
umns... | guess, just like how many licks 
it takes to get to the Tootsie Roll center 
of a Tootsie Pop, the world may never 
know. 


1 Yes, if you clicked on this link, you were just Rickrolled. 
You're welcome. 
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Linking I-O Practitioners Worldwide: 
The International Affairs Committee 
White Paper Series 


In 2010, SIOP’s Executive Board instituted the Interna- 
tional Affairs Committee. This committee was 
launched in an effort to support the works of the Alli- 
ance for Organizational Psychology brought to fruition 
by Gary Latham and Milt Hakel in partnership with 
IAAP and EAWOP leaders. For me (Alex), this was a 
very personal event because it shifted thinking among 
SIOP leaders around international affairs. Prior to this 
moment, International Affairs was a subcommittee of 
the Professional Practice Committee and the only for- 
mal mechanism available to the Executive Board op- 
erationalizing international relations. Before 2010, the 
subcommittee, which | chaired at that moment, was 
responsible for one thing: SIOP’s International Recep- 
tion at the annual conference. Then, one day in May 
2010 | received an email from Dave Nershi and Donald 
Truxillo (then External Relations Officer) indicating 
that the committee had been promoted to a full com- 
mittee and that | needed to start with an agenda and a 
roster. Naturally, | was surprised. Still, | turned to col- 
leagues like Mo Wang to help me extend the commit- 
tee’s agenda and lay out a vision supporting the Alli- 
ance. 


Among the first objectives of the agenda was to create 
venues for international practitioners to share their 
lessons learned with SIOP membership. Similarly, we 
looked for opportunities where SIOP members could 
share lessons learned with the international commu- 
nity. The first venue established nearly 2 years ago 
was this very recurring column that you are reading. 
This column is designed to provide international prac- 
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titioners with a forum for discussing 
relevant topics from their practice. But 
this column is not the only venue devel- 
oped by the committee. In 2010, the 
committee also launched a white paper 
series under the leadership of new com- 
mittee chairperson, Donald Truxillo, and 
committee members, Lynda Zugec and 
Alok Bhupatkar. This white paper series 
was designed to publish collaborative 
international practice ideas on SIOP’s 
website. Today, the white paper series 
is a thriving example of international 
collaboration. It is for this reason that 
we have used our current column to de- 
scribe the accomplishments of this ini- 
tiative. 


To highlight the white paper series ini- 
tiative, we have called upon two com- 
mittee leaders, Lynda Zugec, the com- 
mittee member leading the initiative, 
and Angelo DeNisi, the current commit- 
tee chairperson. 


In 2007, Lynda Zugec founded a human 
resources consulting firm named The 
Workforce Consultants. Following exten- 
sive experience in human resource posi- 
tions throughout North America, 
Europe, and the Middle East, Lynda rec- 
ognized a need to combine the teaching 
and research expertise of highly quali- 
fied academics with the management 
teams responsible for human resource 
policy and practice throughout the busi- 
ness community. This inspired the or- 


ganizational strategy of The Workforce 
Consultants. Prior to creating her own 
company, Lynda was a Human Capital 
Advisory Services consultant with Mer- 
cer Human Resources Consulting Ltd., 
one of the world’s premier human re- 
sources consulting firms. Lynda holds an 
honors degree in Psychology and Ap- 
plied Studies along with a specialization 
in Human Resources Management from 
the University of Waterloo and a mas- 
ter’s degree in Industrial-Organizational 
Psychology from the University of 
Guelph. Lynda also has the distinct 
honor of being our first contributor and 
the first two-time contributor to this 
column. 


Angelo DeNisi is professor of Organiza- 
tional Behavior, and Albert Cohen Chair in 
Business. Prior to coming to Tulane, he 
was the head of the Management Depart- 
ment at Texas A&M University and held 
faculty positions at Rutgers, The University 
of South Carolina, and Kent State Univer- 
sity. He has also taught credit and non- 
credit courses in Singapore, Santo Do- 
mingo, Kuala Lumpur, and Hong Kong. His 
research interests include performance 
appraisal, expatriate management, and 
work experiences of persons with disabili- 
ties. His research has been funded by the 
Army Research Institute, the National Sci- 
ence Foundation, and several state agen- 
cies. His work has also been published in a 
number of top journals in our field, and his 
research has received awards from the OB 
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and OCIS Divisions of the Academy, The 
Academy of Management Executive, and 
SIOP, and SIOP named him the co-winner 
of the 2005 Distinguished Scientific Contri- 
bution Award. He also serves or has 
served on a number of Editorial Boards, 
including AMJ, AMR, JAP, Journal of Man- 
agement, and Journal of Organizational 
Behavior. He was a past editor of the 
Academy of Management Journal. Angelo 
is a Fellow of SIOP and the American Psy- 
chological Association, as well as a Fellow 
of the Southern Management Association 
and of the Academy of Management. He 
served as president of SIOP and president 
of the Academy of Management and is 
presently the past president of the Acad- 
emy of Management. 


International Affairs Committee 
White Paper Series 


Purpose 

The idea behind the International Affairs 
Committee (IAC) White Paper Series is 
to present the most recent topics of in- 
terest to the international I-O commu- 
nity. The end goal of these white papers 
is to make research evidence accessible 
to both scientists and practitioners 
around the globe. In addition, along with 
the Professional Practice Committee at 
SIOP, we have partnered with the Soci- 
ety for Human Resource Management 
(SHRM) to publish certain white papers 
(http://www.siop.org/siop-shrm 
default.aspx), which will illustrate the 
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value of industrial and organizational 
psychology to business, policy makers, 
and the SIOP and SHRM societies at 
large. The goal of our partnership is to 
introduce the science generated by the 
l-O psychology and human resources 
disciplines into daily use within the 
workplace. 


Background 

The history of the IAC White Paper Se- 
ries dates back to 2009 and is based on 
discussions among a number of SIOP, 
EAWOP, and IAAP members, including 
Donald Truxillo, Kurt Kraiger, and Jose 
Maria Peiró. During that time, Donald 
and Jose Maria thought of using some of 
the International Research Incubator 
topics for future white papers. In addi- 
tion, during 2010 —2011, Lynda Zugec 
and Alok Bhupatkar were researching 
different white paper models and had 
several conversations with chairs from 
other committees, including Stuart Carr 
(Massey University) from the separate 
Work Psychology White Papers (WPWP) 
Steering Committee. These initial discus- 
sions were supported by both Lori Fos- 
ter-Thompson (SIOP) and Milt Hakel 
from the Alliance. The April 2012 TIP 


article written by Stuart Carr contains a 
description of our history. 


White Paper Series Committee 
Members 

The current IAC White Paper Series com- 
mittee members include Angelo DeNisi 


(Tulane University) as IAC Committee 
Chair and Lynda Zugec (The Workforce 
Consultants) as the IAC White Paper Se- 
ries Sub-committee Chair. Through the 
past few years, many have served on 
this committee and we look forward to 
inviting both new and experienced 
members to ensure the continued suc- 
cess of the IAC White Paper Series. After 
multiple discussions, the IAC committee 
sent invitations to internationally re- 
nowned experts in the field of I-O psy- 
chology and created the International 
Affairs White Paper Series Board 
(IAWSB). 


International Affairs White Paper 
Series Board 

The IAWSB board members were se- 
lected based on their affiliation to inter- 
national organizational psychology com- 
mittees and expertise in the field of I-O. 
The two main purposes of the IAWSB 
are to (1) identify the white paper topics 
and lead authors for the International 
Affairs Committee White Paper Series 
and (2) review and provide feedback on 
the white papers as they are completed. 
Three members—Fernanda Afonso, Bar- 
bara Kozusznik, and John C. Scott 
(representatives from EAWOP, IAAP, 
and SIOP)—served as board members 
for the 2012-2013 year. We wish to 
thank the three of them for their efforts 
in furthering the IAC White Paper Series. 
John C. Scott will continue to serve as a 
board member for the 2013—2014 year 


and two new board members who rep- 
resent the international 
l-O community will be welcomed. 


Work to Date 


The IAC Committee started the develop- 
ment of the white paper publication 
process in 2011. An overview of the 
white papers published in 2011-12 and 
2012-2013 is presented in the table be- 
low: 


Year Title Authors 


What We Know 
About Applicant 
Reactions on 
Attitudes and 
Behavior: Research 


Talya N. Bauer, Julie 
McCarthy, Neil 

Anderson, Donald M. 
Truxillo, and Jesus F. 


2011- Summaryand Best Salgado 
2012 Practices 
Achieving Well- 
Being in Retirement: Mo Wang, and 


Recommendations 
from 20 Years’ 
Research 


Beryl Hesketh 


Stuart C. Carr, Lori 
Foster Thompson, 
Walter Reichman, 
Ishbel McWha, Leo 
Marai, Malcolm 
MacLachlan, and 
Peter Baguma 


Humanitarian Work 
Psychology: 
Concepts to 
Contributions 


2012- 
2013 


How to Access the IAC White Papers 


There are several websites where you 
can download the IAC white papers 
from. These are listed below. 
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SIOP Website 

White papers can be accessed on the 
SIOP homepage (www.siop.org) under 
the “Publications” tab. Once under this 
tab, click on the heading “White Papers” 
or simply access it here: http:// 
www.siop.org/WhitePapers/ 
default.aspx 


AOP Website 

The SIOP IAC White Papers are also 
available at the Alliance for Organiza- 
tional Psychology (AOP) website and can 
be downloaded here: hitp:// 
www.allianceorgpsych.org/ 
WhitePapers.aspx 


SHRM Website 

As part of the research collaboration 
between SIOP and SHRM, the white pa- 
pers can also be downloaded here: 
http://www.shrm.org/Research 
Articles/Pages/default.aspx 

Once at this web address, click on the 
section titled “SHRM/SIOP Collabora- 
tion.” 


See You Next Time! 


We leave you with this parting thought: 
“What, exactly, is the Internet? Basically 
it is a global network exchanging digi- 
tized data in such a way that any com- 


puter, anywhere, that is equipped with a 
device called a ‘modem,’ can make a 
noise like a duck choking on a kazoo.” 
These words from Dave Barry, although 
obviously humorous, also highlight the 
importance of venues for global net- 
working. The International Affairs Com- 
mittee White Paper Series is one such 
venue and thankfully one devoid of the 
modem-like screeching. Until next 
time, ciao, au revoir, zaijian, and adios! 


WE NEED YOU AND YOUR INPUT! We 
are calling upon you, the global I-O com- 
munity, to reach out and give us your 
thoughts on the next topic: change man- 
agement strategies. Give us your in- 
sights from lessons learned in your prac- 
tice. We are always looking from con- 
tributors, and we will be on the lookout. 
To provide any feedback or insights, 
please reach us by email at the following 
addresses: 
mo.wang@warrington.ufl.edu and 
alexander.alonso@shrm.org. 
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The purpose of this column has always been to dis- 


Max. cuss our “classroom capacity” —how we can be the 
most that we can be as I-O educators (though admit- 
Classroom tedly I’ve strayed from that topic on a few occasions). 


This time out, | want to focus a bit on the technolo- 
gies that are commonly in use in college classrooms 
and how we can make best use of them in the I-O 
classroom. l'Il focus on one technology that’s pretty 
common (clickers), one that isn’t common enough 
(nonlinear web-based case studies), and one that’s 
just my favorite new thing I’ve seen in quite a while 
(the MicBall). 


Capacity 


“Clickers” or Other Student Response Systems 


A couple of issues ago, | wrote about a model that 
Ben Biermeier-Hanson and | had presented about the 
stages of readiness for adoption of educational tech- 
nologies, and we talked about it in the context of us- 
ing Student Response Systems, or clickers. I’ve been 
using clickers for several years now. When | say this, | 
often hear people say “clickers are great!”, or “I used 
clickers once, and they were horrible.” Both of these 
are incorrect statements, because as with all educa- 
Marcus W. Dickson tional technology, it isn’t usually the technology itself 
Wayne State University that is good or bad — it’s what you do with it, and 
whether it helps you achieve your pedagogical goals. 


If you’ve ever watched Who Wants to Be a Million- 
aire? or even America’s Funniest Home Videos, you’ve 
seen clickers in use. They are small hand-held devices 
that allow people to cast “votes” or answer ques- 
tions, and it is possible to tell who answered what on 
a given question. The results of the poll can then be 
displayed, usually as a bar graph. In the classroom, 
this can allow an instructor to: 
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- ask for students’ opinions on specific 
topics and to share the results with 
the class; 

- ask quiz questions and know how 
each student answered; 

- “check in” with students to see 
whether they are understanding a 
topic being presented; 

- use “peer instruction,” in which stu- 
dents are given a question that goes 
beyond the readings or lecture, 
which they first answer independ- 
ently, then discuss with their 
neighbors in class, and then answer 
a second time, allowing for learning 
to occur through the conversation 
with peers; 

- do many, many other things involv- 
ing soliciting student responses. 


There are a number of companies that 
sell stand-alone clickers, with the two 
largest being i>clicker (owned by Mac- 
Millan; www.iclicker.com) and Turning 
Technologies (http:// 
www.turningtechnologies.com/). In ad- 
dition, there are web-based technolo- 
gies, which allow a student to use a lap- 
top, tablet, or smart phone to respond. 
The one I’ve most often seen used in 
classes is called Top Hat Monocle 
(https://tophat.com/). Finally, both 
i>clicker and Turning Technologies have 
“hybrid” systems, so that some students 
can use hand-held clickers and others 
use web-based software on their own 
device. All of these companies have op- 
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tions that allow for either multiple- 
choice answer formats, or alphanumeric 
answer formats. 


For me, the benefits of using clickers 
have been numerous and significant. | 
use them for all of the purposes de- 
scribed above. After explaining what a 
correlation is or how to interpret regres- 
sion results, | put a question up on the 
board that looks like a test question on 
that topic and ask the students to an- 
swer it. If 80% of them can, then | feel 
comfortable moving on to a new topic. If 
only 30% answer it correctly, then | 
know immediately—not a few weeks 
later, after exam results are in—that 
something isn’t clear, and | need to go 
back over it again. 


| also ask students their opinions about 
topics that might be less comfortable to 
talk about at first. For example, | can ask 
students how they feel about affirmative 
action, or Michigan’s new Right to Work 
laws, or preemployment drug testing. 
Then, once the results are in and | show 
on the board how the class as a whole 
feels, | can ask “How do you think some- 
one who says that they strongly oppose 
preemployment drug testing might ex- 
plain their support?” That allows people 
to answer the question and participate 
in the discussion without necessarily 
stating that they personally hold an un- 
popular position. In the drug testing ex- 
ample, | can prod students to think more 


deeply than simply, “They oppose it be- 
cause they want to keep taking drugs” 
by asking “Are there reasons that some- 
one who doesn’t use drugs might also 
oppose that sort of testing?” Finally, | 
can highlight the actual responses in the 
classroom, which makes it hard for any- 
one to assert that “everyone | know 
agrees with me on this,” when the data 
suggest a wide range of opinions or re- 
sponses. 


In short, the benefit for me of using this 
particular technology really has little to 
do with the technology itself. The bene- 
fit is that it allows me to quickly and effi- 
ciently gather data that can help me be 
more effective in the classroom. It might 
mean giving a topic additional review 
because | know students are not 
“getting it,” it might mean having a 
more productive discussion than we 
would have had simply relying on people 
to state their opinions, and it might 
mean allowing students as peers to in- 
struct each other by discussing challeng- 
ing questions and figuring it out for 
themselves. All of these could happen 
without clickers—they’re just easier, and 
faster, with clickers. (Again, for me, 
maybe not for you.) 


Online Cases 
Many of us use cases in our teaching, 


and the traditional I-O/management 
case follows a pretty standard, linear 


path. That’s because we read it, and so 
we read it in the order it comes on the 
pages. But not all cases are like that, and 
cases don’t have to be that way. There 
aren’t a lot of examples out there, but 
one of my favorites is called “Play,” writ- 
ten/developed by Joe Harder. It’s pub- 
lished by Darden Business Publishing 
and is web-based, with lots of video 
clips. The focus of the case is leadership 
and culture management: The culture of 
the organization is very strong, but is 
very much embodied in the CEO. Now 
that the organization is growing and ex- 
panding to a new location, how will the 
culture carry over when that leader is no 
longer on site nearly as often? 


One thing | love about this case is that it 
is nonlinear. Students can choose what 
topics to focus on in the case or they can 
“walk through” a map of the office and 
“stop in” to different employees’ offices 
to see interview videos about their 
thoughts, as well as notes, questions, 
and other videos about life in this com- 
pany. In many ways, the experience of 
the case mimics what one could experi- 
ence as a new consultant entering the 
organization, without quite knowing 
where to look first to understand what 
the real issues are, and what’s really go- 
ing on. 


The case is a little older now, but it 
doesn’t feel dated. My concern as some- 
one interested in using effective educa- 
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tional technology in the classroom is 
that there are not enough cases like this 
out there. But give this a look if you’re 
looking for something different for your 
students to investigate leadership and 
culture issues, or if you simply want 
them to have a different experience of 
learning about an organization and its 
challenges. You can get information on 
Play from 
sales@dardenbusinesspublishing.com. 


The MicBall 


| first saw a MicBall at a conference, and 
knew we had to have one in our depart- 
ment. It’s mostly good for larger class- 
rooms, classrooms large enough that you 
may not be able to hear students’ ques- 
tions clearly, or where students aren’t 
able to hear other clearly. That may not 
be a lot of I-O classrooms, but | know it 
certainly is some. 


A MicBall is a leather-covered ball, sort 
of like a soccer ball but a little smaller. 
Inside the ball is a wireless microphone. 
There is a push-to-talk button and a la- 
ser pointer. When a student has a ques- 
tion or wants to make a comment, he or 
she simply raises a hand, and the other 


students can then toss (not throw!) the 
ball that direction until it gets to the stu- 
dent who wants to speak. Because of 
the push-to-talk button, there’s no extra 
noise as the ball moves along. If the stu- 
dent has a question about something on 
screen, the built-in laser pointer allows 
the student to point to exactly the thing 
on screen that he or she is wondering 
about. 


MicBalls come with all of the audio 
equipment (including a battery charging 
station) that you need to connect to a 
lecture hall’s existing sound system. 
Fundamentally, it’s just like adding an- 
other microphone in to the system, ex- 
cept with this one, you don’t have to run 
around the classroom to hear the stu- 
dents or repeat back their questions so 
everyone else can hear them, and so on. 
Check it out at www. micball.com. 


We’ve just ordered our first MicBall, and 
by the time you read this, we’ll have had 
it in use for a while. Send me a note to ask 
how it’s going, or to talk about any of the 
other educational technology topics I’ve 
mentioned here. I’m at 


marcus.dickson@wayne.edu. 
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Three Bold Ideas 


SIOP 2013 in Houston inspired three bold ideas 
that are the basis for this column. This new electronic 
format for TIP permits me to expand the envelope in 
the presentation of The High Society. For the first 
time in history | will include photographs in this col- 
umn. I am so excited! 


|. SIOP 2014 Workshops 
| was walking down the hall in the convention hotel 
minding my own business when a member of the 
Workshop Committee cornered me. He said the 
committee was afraid the SIOP 2014 workshops 
may be poorly attended. He asked me to use my 
creative verbal talents to gin up some exciting 
workshops. He obviously had no sense of shame, 
thinking that The High Society had a request line 
and that it was open to him. | must have even less 
shame because | agreed to this gig. So here is the 
deal. | propose that because SIOP 2014 will be held 
in the tropical paradise of Hawaii, it is time for 
some organization—environment congruence. 
That’s right; in 2014 there will be no florescent 
lighting, PowerPoint slides, or stuffy air in our work- 
shops. All workshops will be held outdoors. Here 
are five workshops that I think would not only ap- 
peal to our members but would also play to our 
being situated just this side of heaven. | would not 
be proposing these particular workshops if SIOP 
were being held in, for example, Cleveland. 


1. Branding a State 
It is one thing for an organization to be based 
around the persona of one individual. It is quite 
another for one individual to symbolize an entire 
state. Yet that is the story of Hawaii. Since the 
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granting of statehood in 1960, singer 
Don Ho and his signature song, “Tiny 
Bubbles,” became the iconic identity 
of Hawaii. This workshop will be 
held at Diamondhead and will be led 
by Don’s lovely wife, Heidi. She will 
describe what it was like to brand a 
state through relentless creative 
marketing. Breakout groups will be 
led by their three sons, Land, Gung, 
and Westward. The workshop will 
close with the signing of a formal 
proclamation that the next time our 
group comes to Hawaii, we will refer 
to ourselves as the Society for Hi-Ho 
Psychology. 


2. Performance Evaluation— 
Hawaiian Style 

This workshop will be held at 
Waimea Bay, home of huge waves 
that have attracted surfers from 
around the world. Each participant 
will be provided with a 16-foot surf- 
board. Participants will be classified 
into three groups based upon their 
performance in riding home a 70- 
foot wave. The first group will slice 
the wave, hang 10, and be the em- 
bodiment of Hawaii cool. The sec- 
ond group will desperately wrap 
their arms and legs around the 
board, pray to some island deity, 
and promise themselves if they can 
just survive, they will never again 
leave a landlocked state. The third 
group will not have their careers be 
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plateaued or derailed, but wiped 
out. Their performance evaluation 
will result in what the locals call a 
“burial at sea.” 


3. Hawaiian Treasure Hunt 
This workshop emphasizes competi- 
tion among participants as they fan 
out across the islands in search of 
the grand prize, Barack Obama’s 
birth certificate. Participants will be 
encouraged to look high and low for 
this coveted document. The winner 
will no longer need SIOP, as he or 
she will become an instantaneous 
international celebrity. The partici- 
pants who fail to locate the Holy 
Grail but who ruffled a lot of feath- 
ers while searching will undoubtedly 
enter into a long term relationship 
with the Secret Service. This work- 
shop will be led by Donald Trump. 


4. Displaying Culture-Specific Emotions 
This workshop will be held at Wai- 
kiki Beach with participants wearing 
grass skirts and a pair of strategically 
placed coconuts. The exact position- 
ing of the coconuts will depend 
upon the gender of the participant. 
The workshop will assess proficiency 
in avoiding culturally inappropriate 
displays of emotion. The word “lei” 
is endemic to the Hawaiian culture 
and is no laughing matter to the lo- 
cals. Participants who either giggle 
or smirk during their orations will be 


voted off the island. The participant 
who remains stoic throughout this 
intensive assessment will be de- 
clared the winner. Before the win- 
ner is graced with a prize (a you- 
know-what), EMT personnel will first 
ascertain that the individual has a 
pulse. 


5.Assessment With a Hawaiian 
Purpose 
Participants will first use the method 
of peer ranking to establish among 
themselves who is first on down to 
who is last, without knowing what is 
in store for them. They will then be 
airlifted to an exciting remote loca- 
tion, an active volcano. The partici- 
pants will form a human chain. The 
person who was ranked last will be 
closest to the rim of the volcano. 
The clever schmuck who used a 
combination of guile and aggression 
to be ranked first gets to fill a bucket 
with molten lava. All participants 
will develop a greater appreciation 
for why we always must first estab- 
lish the reason for assessment be- 
fore doing so. The bucket-holder 
undoubtedly will also reach a termi- 
nal understanding of why l-O psy- 
chologists invented simulations. 


If you would like these types of work- 
shops at SIOP 2014, so inform the Work- 
shop Committee. How participants will 
receive CEUs for these workshops is not 


my problem. My service to SIOP is 
boundless. Aloha. 


ll. Birth of a New Concept 

| have reached the point in my career 
that after writing 10 editions of my text- 
book spanning over 30 years, | decided it 
was time to take on a coauthor starting 
with the 11" edition. | wanted my coau- 
thor to be the very best: bright, moti- 
vated, and innovative. After much delib- 
eration | asked Tori Culbertson of Kan- 
sas State University to help me carry on 
the tradition of Psychology Applied to 
Work deep into the future. To my great 
delight, Tori agreed. As I only get to see 
Tori at SIOP, | thought it would be propi- 
tious for us to be photographed to- 
gether, sort of a formal portrait shot 
emblematic of the forthcoming era of 
my book. 


We agreed to meet in the hotel lobby at 
9:00 pm for the photo shoot. | looked 
for her and couldn’t find her. The only 
person | saw was someone of diminutive 
stature sporting a thick moustache that 
would be the envy of Tom Selleck. The 
person approached me and whispered, 
“Paul, it’s me, Tori.” While | was wearing 
a cowboy hat befitting Houston, Tori’s 
get-up exceeded my standards for inno- 
vation. The fact she was exhibiting more 
testosterone than me made it even 
more surrealistic. Here is the official por- 
trait of the two of us. 
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ess, he discovered he may have inadver- 


tently stuffed two copies of my flyer in 


Bee one bag. He then uttered the prophetic 


Even after taking the photograph | still 
couldn’t wrap my brain around the fact | 
just agreed to partner with a highly com- 
petent, heavily moustached woman. It 
was then | realized a new concept had 
just been born in I-O psychology: the 
validity—perversity dilemma. 


lll. SIOP Now Has an Official Drink 

This is the story of highly reactive creativ- 
ity. The aforementioned Tori Culbertson 
led a group of graduate student volun- 
teers in stuffing conference bags with 
promotional items provided by sponsors. | 
had an item that promoted my book, a 
semi-stiff flyer. The students were stuffing 
the bags in an assembly line fashion. One 
student volunteer, Daniel Shore of 
George Mason University, happened to 
be stuffing the bags with my particular 
item. In the midst of this fast-paced proc- 
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words, “Oh-oh, | think | just gave some- 
one a double Muchinsky.” A second stu- 
dent working the line next to him, Laura 
Lomeli of Texas A&M University, said, “A 
‘Double Muchinsky’ sounds like the name 
of a drink.” Then spontaneous intellectual 
combustion occurred. The two young en- 


 trepreneurs decided the ingredients for a 
| Double Muchinsky were two shots of Rus- 


sian vodka, orange juice, pineapple juice, 
a splash of grenadine, topped off with a 
plastic sword impaling a cherry and or- 
ange slice. The final adornment would be 
one of those cute little umbrellas. 


Mr. Shore and Ms. Lomeli wondered if | 
would find this story to be amusing. In 
short, they questioned whether I have a 
sense of humor. Can you believe that? Do 
bears disburden themselves in the 
woods? Obviously, neither one of them 
reads The High Society. Dr. Culbertson 
assured the creators that by sharing this 
story with me | would neither physically 
harm them nor sabotage their careers. 


Before too long Mr. Shore hurried him- 
self to my booth in the Exhibition Hall, 
telling me with great excitement that he 
and a fellow student had just developed 
the official drink of SIOP, the Double 
Muchinsky. Needless to say, | thought it 
was a brilliant idea, but the umbrella 
had to go. | informed him that because 


he was the first to tell me about the new 
drink, he would get first-author credit 
for it. Shortly thereafter, Ms. Lomeli also 
shows up in my booth to share in the 
afterglow of discovery. | politely in- 
formed her she would be second author 
in creating what would be known as the 
“Shore-Lomeli Double Muchinsky.” 
Without so much as providing a shred of 
empirical evidence, she says the “Lomeli 
-Shore Double Muchinsky” would be 
more appealing. | couldn’t help but 
agree with her judgment. | then turned 
the occasion into what we professors 
like to calla “teachable moment” with 
students. Mr. Shore learned you should 
never count your chickens before they 
hatch, as first authorship had just been 
swiped right out from under his nose for 
political reasons. Ms. Lomeli, the more 
socially adroit of the pair, learned that 
sometimes you can get your way by just 
appealing to face validity. | trust that her 
dissertation will exhibit more methodo- 
logical rigor. So on that day, April 12, 
2013, the “Lomeli-Shore Double 
Muchinsky: The Official Drink of SIOP,” 
was created. 

| was so happy for these kids. Graduate 
students in l-O psychology can feel special 
by getting publications, but to be immor- 
talized by having the official drink of SIOP 
named after you is unique. | just hope 
they haven’t reached the peak of their 
careers while still in graduate school. 
Given the professional visibility | have af- 
forded them, | don’t think | would be out 


of line to expect each of them to name 
their first-born male child after me. How- 
ever, given the specific nature of their 
accomplishment, | wouldn’t be surprised 
if they each had twin boys. 


That night we went to the hotel bar. | 
emphatically told the bartender, “I want 
a Double Muchinsky. A Lomeli-Shore 
Double Muchinsky.” It sounded like a 
line from a James Bond movie. Some- 
how | got roped into buying about 10 of 
them for the pioneering authors, plus 
the members of their ever-increasing 
entourage. They told me the drink sort 
of looked like the cover of the current 
edition of my book. It did. Here is a 
photo of the drinks on the bar. 

The second photo is of the two authors 


each holding a Double Muchinsky, one 
of them holding the two flyers that 
birthed the drink, and me, not holding a 
Quadruple Muchinsky, but a pair of Dou- 
ble Muchinskys. 
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who coattail off of student accom- 
plishments. | can assure you that | 
am not the first to do so. 


| have two major reactions to this 
wonderful moment in my life. First, 
| am honored by the “Lomeli-Shore 
Double Muchinsky: The Official 
Drink of SIOP.” Second, | am re- 
lieved that Lomeli-Shore did not 
The final photograph shows the person propose the ingredients of the Double 
who incubated this whole affair, the two Muchinsky be two shots of prune juice 
authors, me, and in the background a and a splash of Geritol with a Viagra 
growing gaggle of groupies who | pro- chaser. 

claimed to be the designated drinkers. 


Kuder-Richardson, Spearman- 
Brown, Myers-Briggs, Schmidt- 
Hunter, and now, Lomeli-Shore. 
Barely out of puberty, these two 
kids have hit the hyphenated big 
time. The only way my name will 
ever achieve hyphenated immor- 
tality is if the Double Muchinsky 
becomes known as the Muchin- 
sky-Muchinsky. | don’t see it hap- & 
pening. There are few things <= 3 
more pathetic than professors s 5 AW 


SOE i a 
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History Equity Theory at 50 
Corner In the November 1963 issue of the Journal of Abnor- 
mal and Social Psychology, Belgian born social psy- 
chologist J. Stacy Adams published an article entitled 
“Toward an Understanding of Inequity,” which marks 
the beginning of equity theory (Koppes, 2007; Latham 
& Budworth, 2007). At the time, Adams had what must 
have been a great job working at General Electric’s 
Behavioral Research Service (BRS), among noteworthy 
l-O psychologists (and eventual SIOP Fellows) Herbert 
Meyer (1917-2006) and Melvin Sorcher. There was 
even an advisory group for the BRS which included 
social psychology legend Leon Festinger (1919-1989) 
and Nobel Prize Winner Herbert Simon (1916-2001; M. 
Sorcher to G. Latham, personal communication, Au- 
gust 28, 2013). Adams once relayed the story of how 
he became interested in inequity to his PhD student, 
Robert Folger. Apparently, one of Adams’s coworkers 
at GE would express guilt at being paid too much 
S money. It astounded Adams that someone would be 
"j f \ so upset about being overpaid. Adams developed an 
tee interest in what he called “advantageous ineq- 
uity” (Folger, personal communication, August 27, 
2013). 


Kevin T. Mahoney 
South Dakota State 
University 


Adams’ 1963 article presents the theory of inequity as 
a special case of Festinger’s cognitive dissonance the- 
ory. Adams insists that, “The fairness of an exchange 
between employee and employer is not usually per- 
ceived...simply as an economic matter. There is an ele- 
ment of relative justice involved that supervenes eco- 
nomics and underlies perceptions of equity or ineq- 
uity” (p. 422). In the course of the article, Adams intro- 
duces much of the language we associate with equity 
theory. “Inputs” are variables a person brings to a so- 
cial exchange (to the job) such as education, experi- 
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ence, and, most importantly, effort. In- 
puts need not be recognized by the 
other party of the exchange. Adams pro- 
vides a memorable example of this, con- 
sidering Parisian and non-Parisian born 
bank clerks working together. Parisians 
viewed their breeding as an input, enti- 
tling them to higher wages. Bank man- 
agement didn’t consider birthplace an 
input relevant for pay. “Outcomes” were 
rewards individuals received for their 
services, including pay, intrinsic rewards, 
and status symbols. (Adams, 1963). Ad- 
ams explains that perceptions of ineq- 
uity emerge from comparing one’s own 
inputs and related outcomes to some 
comparison others’ inputs and related 
outcomes; the comparison other usually 
a coworker. Adams provides signature 
tenets of equity theory: “When the nor- 
mative expectations of the person mak- 
ing social comparisons are violated— 
when he finds his inputs and outcomes 
are not in balance in relation to those of 
others—feelings of inequity result” (p. 
424). Adams insists that inequity results 
regardless of whether the comparison is 
favorable or unfavorable. Experienced 
inequity then triggers tension (as in 
Festinger’s 1957 cognitive dissonance 
theory), of which individuals are moti- 
vated to rid themselves. Adams suggests 
several ways individuals may act to re- 
duce inequity (decreasing inputs relative 
to another, psychologically distorting 
inputs and outcomes, changing the com- 
parison other, even “leaving the field”). 
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Adams concludes with several experi- 
mental and observational studies (some 
of which he conducted himself at GE) as 
evidence for his new theory. 
In 1965, Adams published a chapter in 
Advances in Experimental Social Psychol- 
ogy entitled “Inequity in Social Ex- 
change.” This has become a more popu- 
lar paper (it has more than 8,000 cites 
on Google Scholar, in comparison to 
fewer than 4,000 for the 1963 article, 
for example), and may have served to 
obscure the earlier publication. Clearly, 
Adams had refined his definition of ineq- 
uity by this point: “Inequity exists for 
Person whenever he perceives that the 
ratio of his outcomes to inputs and the 
ratio of Other’s outcomes to Other’s 
inputs are unequal.” There was no talk 
of “ratios” in the earlier publication. Fur- 
thermore, the handy equations we know 
so well and associate with equity theory 
% O 


pop up, for example * 7 reflects a 


comparison where the person perceives 
overpayment. Still, much of the content 
of the book chapter seems drawn from 
the earlier article. 


Research into equity theory followed. As 
Latham and Budworth (2007) explain, 
equity theory faced early criticism for 
lacking precision (Campbell, Dunnette, 
Lawler, & Weick, 1970) and for lacking 
the predictive power of expectancy the- 
ory (Lawler, 1970). In this publication, 
equity theory was classified as a “not-so- 


useful theory;” though laboratory re- 
search on equity theory had been suc- 
cessful, it had not moved to a specific 
application (Miner, 1984). Adams him- 
self had become less interested in equity 
theory by the mid-1970s (Folger, per- 
sonal communication, August 27, 2013). 
Overall, research into equity theory may 
be best viewed as mixed (Levy, 2013). 


What sort of impact has equity theory 
had after 50 years? Motivation expert 
Gary Latham suggests equity theory, 
“has great explanatory power on why 
some of us are satisfied versus dissatis- 
fied with our pay” (Gary Latham, per- 
sonal communication, August 29, 2013). 
In particular, he applauds the brilliance 
of the idea of a comparison other. Eq- 
uity theory explains how, for example, a 
psychology professor whose comparison 
other is a professor at another psychol- 
ogy department may perceive equity, 
but if the comparison other is in at busi- 
ness department, they may feel under- 
paid (Gary Latham, personal communi- 
cation, August 29, 2013). Regardless of 
where we work, whether we perceive 
inequity in our pay may depend simply 
on our choice of comparison other. 


Equity theory has also spurred research 
and fostered the development of new 
organizational theories. Adams’ famous 
PhD student, Robert Folger, along with 
others such as Jerald Greenberg, have 
taken elements of equity theory 


(distributive justice) and added other 
components (procedural justice) and cre- 
ated organizational justice theory (Gary 
Latham, personal communication, August 
29, 2013; Latham & Pinder, 2005). Organ- 
izational justice theory continues to have 
an enormous impact both on the overall 
field of |-O (Colquitt, Conlon, Wesson, & 
Porter, 2001) as well as on specific areas 
like performance appraisal (Folger, Ko- 
novsky, & Cropanzano, 1992). Equity sen- 
sitivity, the individual difference in how 
people are affected by overreward or un- 
derreward, is another influential offshoot 
of equity theory (Levy, 2013). For I-O psy- 
chologists, perhaps the most lasting im- 
pact of equity theory will be that it “made 
the subject of justice and fairness a note- 
worthy arena of theory and research” 
(Folger, personal communication, August 
27, 2013). 
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Good 
Science— Weighing In on Telecommuting 


Good Telecommuting has been heightened in the national con- 
versation since being raised with humor and fervor in the 
press in reaction to Yahoo’s decision to curtail telecom- 
muting. l-O psychologists contribute to research-based 
policies that allow organizations to successfully compete 
and implement strategy. Anecdotally, telecommuters can 
save the company costs, bring workers satisfaction, and 
positively affect productivity. However, having workers 
cut off from the company culture and information stream 
may have negative effects. Some CEOs worry about slack- 
ing off and using company time for personal and house- 
hold chores. Our hypothetical CEO asked about the pros 
and cons of telecommuting based on our observations of 
the literature. The real estate and facilities staff are busy 
analyzing their cost savings. While operations leaders are 
conducting a pilot study, we have an opportunity to frame 
the discussion from our perspective. 


Practice 


We immediately notice that the literature is multidisci- 
plinary and some of the discussions in HR forums are 
based on what large companies such as IBM and AT&T 
Tom Giberson do with their workforces. Mamaghani (2012) cites that 
Oakland University the Census Bureau recorded a 61% jump in telecom- 
muting between 2005 and 2009. They describe the 
primary challenges to telecommuting as security and 
"N technical concerns. There are hardware, software, and 
à training needs to meet these requirements. He also 
' suggests that employee commitment and productivity 
N should be examined with productivity including hours, 
f intensity, and efficiency as well as an adjustment for 
additional support required from the organization. 
Some findings suggest that the extra productivity from 
telecommuting comes from the assumption that travel 


Suzanne Miklos time for telecommuters is recommitted to work. 
O.E. Strategies 
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A research-based article by Dutcher 
(2012) examined the role of routine ver- 
sus creative tasks as they impact pro- 
ductivity of telecommuters. Students 
were given a primary task intended to 
simulate data entry. In the second crea- 
tive work condition, subjects identified 
unusual uses for common objects. Stu- 
dents were incented and could shift to a 
secondary distracting task—playing tic 
tac toe—in both conditions. Students 
were randomly assigned to work in a lab 
or outside of the lab. Their results 
showed that working in the lab resulted 
in higher productivity for the primary 
boring task and working out of the lab 
resulted in higher productivity for the 
creative task. The researcher also looked 
at procrastination and need for control 
as mediating variables; nonprocrastina- 
tors and those not needing control were 
more productive in the lab on the mun- 
dane task. Procrastinators and those 
needing control were more productive 
outside the lab on the creative task. This 
study, while limited, points to the need 
to consider the tasks and the context. 


A meta-analysis conducted by Gajendran 
and Harrison (2007) found that telecom- 
muting was related to higher perceived 
autonomy, lower work-family conflict, 
and positive relationships with supervi- 
sors. Low intensity (office-centered) 
telecommuting does not have a relation- 
ship with coworker relationships but 
high intensity (home-centered) telecom- 


muting had a negative correlation to 
coworker relationships. The authors 
concluded that telecommuting was 
mostly positive based on their analysis 
of 46 studies. However, our CEO is also 
interested in how the organization is 
impacted. If coworker relationships are 
impacted by high intensity telecommut- 
ing, how might that affect the organiza- 
tion? One possible place to examine is 
knowledge transfer. 


Taskin and Bridoux (2010) provide a con- 
ceptual frame to examine knowledge 
transfer given that managerial and pro- 
fessional workers are represented in 
telework. Telecommuters tend to be 
more highly educated, have higher in- 
come levels, and be knowledge-based 
workers. The framework that they pro- 
vide includes shared mental models, 
identification with the organization’s 
goals and values, and close relation- 
ships. They set out to consider how tele- 
commuting can affect these dimensions. 
Shared mental models and ways of 
thinking are developed through multiple 
channels such as social interaction, body 
language, and verbal narrative. They 
point out that numerous studies suggest 
that workers identify less with a com- 
pany after moving from office-based 
work to telecommuting. Of course, loca- 
tion of telecommuting and frequency 
would play roles in the frequency of con- 
tact. 
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At a more macro-level, Mayo, Pastor, 
Gomez-Mejia, and Cruz (2009) worked 
with 122 CEOs to examine a variety of 
“fit” variables, including firm size and 
age, workforce composition, and CEO 
leadership style and their relationship 
to the adoption of telecommuting poli- 
cies. Previous research suggests that 
younger firms and smaller firms are 
more likely to adopt progressive poli- 
cies such as telecommuting (c.f., 
Cardon & Stevens, 2004; Leung, 2003). 
Firms with international workers must 
rely on a variety of nontraditional 
methods to manage employees. Tele- 
commuting and connecting through 
information technology, the authors 
argue, is a management tool that can 
help manage employees across bor- 
ders. The authors further argue that 
leaders that utilize a contingency re- 
ward leadership style will also be more 
likely to adopt telecommuting policies. 
This leadership style is characterized by 
the establishment of clear expectations 
for performance and clearly identified 
rewards for achievement. Through ar- 
chival research and interviews with the 
122 CEOs, the authors found support 
for several of their hypotheses. Tele- 
commuting is more likely to exist in 
organizations that are smaller, have a 
high percentage of international em- 
ployees, and emphasize variable 
(contingent) pay. The authors also 
found a few significant interactions; 
younger companies and internationally 
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oriented organizations are much more 
likely to adopt telecommuting policies 
if they are led by CEOs having a contin- 
gency-reward approach to leadership. 


As our CEO analyzes her pilot of tele- 
commuting in our fictitious organiza- 
tion, we can suggest that the infrastruc- 
ture and ongoing costs of support are 
considered in alignment with produc- 
tivity impacts based on the work. We 
may want to consider measuring how 
frequency of telecommuting, light to 
heavy, impacts our workforce. In addi- 
tion, because our company has key 
strategies that require learning organi- 
zation capacity, we may want to further 
examine how informal knowledge is 
captured and organized in order to al- 
low us to understand how telecommut- 
ing will impact our employees. We 
would also want to compare her own 
beliefs and practices regarding reward 
systems to ensure they are compatible 
with telecommuting. Although it seems 
clear that telecommuting can have a 
positive impact on our workforce, or 
CEO is equally interested in managing 
the impacts on financial performance. 
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International SIOP Members; 
Recognition Equity: 
Does SIOP Value Practitioners? 


Over the years SIOP has gained numerous interna- 
tional members. In this article we identify the loca- 
tions and employment categories of the international 
professional members of SIOP. Recently we identified 
the geographic locations of all SIOP U.S.-based profes- 
sional members (Silzer & Parson, July, 2013b). We also 
provide a 2012-2013 update on membership represen- 
tation among SIOP new Fellows, Award winners, Ap- 
pointments and Executive board, and discuss whether 
SIOP has made any progress in recognition equity 
among its membership. 


SIOP International Professional Members 


Over the years SIOP has made some effort to attract 
international members. We were interested in finding 
out more about this membership group. All interna- 
tional SIOP professional members (non-U.S. based) 
were identified in the 2011 membership database and 
are summarized by country in Table 1. 


The top ranked locations of international members 
(top 10 ranks, 11 countries with at least four mem- 
bers) are primarily in Europe (5 countries) and Asia (4 
countries), although Canada, with 101 members, has 
40.7% of all international members. Here is a mem- 
bership breakdown by geographic region: 


e North America (non-U.S.): 3 countries, 104 members 
e Europe: 14 countries, 63 members 

e Asia: 9 countries, 63 members 

e Middle East: 4 countries, 15 members 
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Table 1 
International SIOP Members by 2011 Primary Employment Focus 


Rank Country Academics Researchers Total 
1 Canada 70 7 101 
2 Australia 18 20 
3 England 14 19 
4 China 9 15 
4 Singapore 12 15 
6 Israel 10 11 
7 Netherlands 9 10 
8 Germany 7 8 
9 Switzerland 5 6 
10 India 4 
10 Italy 4 4 
12 Belgium il 3 
12 France 3 3 
12 Portugal 3 3 
12 South Korea 2 3 
16 Japan 2 2 
17 Lebanon 2 2 
17 Mexico 2 
17 New Zealand il 2 
17 Spain 2 2 
21 Cayman Islands 1 
21 Chile il 1 
21 Denmark 1 1 
21 Iran il 1 
21 Ireland 1 
21 Latvia il 1 
21 Norway 1 1 
21 Romania 1 1 
21 South Africa 1 1 
21 Sri Lanka il 1 
21 Taiwan il 1 
21 UAE 1 1 
21 Venezuela 1 
Grand Total 184 7 248 


* Inclusion in an employment group was determined by 2011 member self-report data 
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e South America: 2 countries, 2 
members 
e Africa: 1 country, 1 member 


These data indicate that we have as 
many SIOP members in Asia as we do in 
Europe. Given all the attention SIOP has 
devoted to connecting with EAWOP 
(European Association of Work and Or- 
ganizational Psychology), it might have 
been expected that SIOP would have 
more Europe-based members. However 
some Asia-based members are actually 
Americans who are working in Asian 
countries, such as Singapore and China. 
It is surprising that we have so few mem- 
bers in South America. Many countries 
in South America have substantial num- 
bers of psychologists, such as Argentina 
and Brazil, but there are no SIOP mem- 
bers in either of these two countries. 


It is worth noting that the overwhelm- 
ing majority of international members 
(191 members, 77%) are academics 
and researchers. In only a few coun- 
tries are international members more 
likely to be consultants/ practitioners 
in organizations than academics/ 
researchers — India, Belgium, Mexico, 
Cayman Islands and Venezuela — and 
the numbers here are fairly small. 
Here are the employment categories 
of international members: 

- Consultants (n = 40) 16% 

- Organizational-based practitioners 

(n =17) 7% 
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74% 
3% 


- Academics (n = 184) 
- Researchers (n = 7) 


These data raise the question of why 
SIOP is attracting international aca- 
demics and not international practitio- 
ners. Perhaps SIOP needs to do more 
to attract practitioners who are based 
in other countries. Should SIOP do 
more to connect with our interna- 
tional membership and do a better job 
of reaching out to I-O practitioners in 
other countries? Many of our U.S.- 
based practitioners are doing work in 
other countries; maybe SIOP should 
be more actively building an interna- 
tional I-O practice network and not 
just an international academic net- 
work (i.e. AOP, see below). 


The top international locations for 
SIOP members in particular employ- 
ment focus categories are listed in 
Table 2. The academics listed in Table 
2 (top 10 countries) are evenly split 
between Europe (5 countries, 39 
members) and Asia, (3 countries, 39 
members), after considering Canada 
(70 members). The consultants 
(nonresearch) listed in Table 2 
(countries with at least 2 consultants) 
are primarily in Canada (17 members) 
and in Asia (3 countries, 10 members), 
with Europe a distant third (2 coun- 
tries, 5 members). 


We were interested in trying to deter- 


Table 2 tralia, and China, we could not accu- 


International SIOP Members by rately determine who among the inter- 
Employment Focus and Country national members are Americans based 
Slop academic members 7 ONthe 2011 membership database. But 
“Rank — Couty = # the data did provide the graduate insti- 
~ Canada 70. 7 tution and graduate major for most of 

2 Australia 18 these members. Table 3 identifies how 

3 England 14 many members in each country hold 

4 Singapore 12 U.S. graduate degrees versus non—-U.S. 

5 Israel 10 graduate degrees. 

6 China 9 

6 Netherlands 9 There is a clear trend in some countries. 

8 Germany 7 In Canada, 71% of the international mem- 

3 Switzerland 5 bers (72 members) hold non-U.S. de- 

10 Italy 4 


grees, presumably from Canadian institu- 
tions (also 76% of these members are 


SIOP organizational members . . 
8 academics or researchers). The predomi- 


ia mann nance of non-U.S. degrees is also true of 
2 other countries such as England (72% non 
2 —U.S. degrees), Germany (100%), Italy 

(100%), and Netherlands (80%). 
SIOP consultant members 

Rank Country # However, other countries, particularly in 
1 Canadi 17, Asia, have greater percentages of inter- 
2 hina 5 national members who hold U.S. gradu- 
3 ate degrees, such as Australia (60% U.S. 
3 degrees), China (60%), India (100%), Is- 
5 rael (64%), Singapore (67%), and South 
: Korea (100%). 


* Inclusion in an employment group was determined 


by 2011membër selfreport data The global trend is pretty clear: 


- Europe based members (14 coun- 


mine how many of these internationally tries): 70% non—U.S. degrees, 30% 
based members are Americans or at U.S. degrees 

least U.S. educated. Although we know - Asia based members (9 countries): 
there are a number of Americans work- 25% non-U.S. degrees, 75% U.S. 
ing overseas, such as in Singapore, Aus- degrees 
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Table 3 
International SIOP Members by Country 


Holding U.S. and Non-U.S. Doctoral-Level 


Non-U.S. 
Country Degree U.S. Degree Total 
Australia 
Belgium a 2 
Canada 29 101 
Cayman Islands 1 1 
Chile 1 
China 9 15 
Denmark 1 
England 5 18 
France 3 3 
Germany 6 
India 4 4 
Iran il 1 
Ireland al 1 
Israel 7 11 
Italy 4 
Japan il 2 
Latvia il 1 
Lebanon al 1 
Mexico il 2 
Netherlands 2 10 
New Zealand 1 2 
Norway 1 
Portugal 3 
Romania 1 
Singapore 10 15 
South Africa 1 
South Korea 3 3 
Spain il 2 
Sri Lanka al 1 
Switzerland 3 5 
Taiwan 1 
UAE al 1 
Venezuela 


* Data is based on 2011 member self-report of doctoral level 


degrees 
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These data suggest that European-based 
members are highly likely to be Euro- 
pean-educated academics and join SIOP 
to affiliate with a U.S. academic-oriented 
l-O psychology organization. However, 
our Asia-based members are highly likely 
to be U.S.-educated and probably Ameri- 
cans who have moved to Asia for em- 
ployment opportunities. Although 
Europe has more established I-O psy- 
chology academic institutions and pro- 
fessional communities, Asia is the region 
of the world that is undergoing signifi- 
cant economic development and cur- 
rently may offer more employment op- 
portunities for U.S.-educated 

l-O psychologists. 


We also identified the graduate majors 
for all 2011 international members and 
determined whether they were associ- 
ated with non-U.S. or U.S. graduate 
degrees (see Table 4). As the data sug- 
gest for most graduate majors there is 
a mix of U.S. and non-U.S. graduate 
degrees. However international mem- 
bers are more likely to hold a non-U.S. 
degree if their graduate major is in or- 
ganizational psychology (76% non-U.S. 
degrees) or organizational behavior 
(57% non-U.S. degrees). One compli- 
cation is that this is based on self- 
report data, and therefore, the self- 
identified graduate major may not be 
entirely accurate or may not be compa- 
rable to a U.S. graduate major with the 
same name. 


Table 4 


International SIOP Members by Graduate Major Holding U.S. and Non- 


U.S. Doctoral-Level Degrees 


U.S. Degree Total 
Business 3 3 
Clinical Psychology 3 6 
Human Resources 2 6 
Industrial-Organizational Psychology 65 135 
Management 4 5 
Organizational Behavior 10 23 
Organizational Development 1 
Organizational Psychology 4 17 
Social Psychology 8 16 

Total 99 212* 


* Data is based on 2011 member self report of doctoral level degrees 
** The degree and major field of some members is unknown 


Summary Recognition Equity in SIOP: An Update 
A few conclusions can be drawn about Over the years SIOP has promoted itself 
the SIOP international members. as focused on “Integrating Science and 
- The largest group is in Canada, while Practice at Work” (SIOP website, 
Europe and Asia have equal num- www.SIOP.org, 8-14-13). This has been 
bers of members expressed in several ways: 


- The overwhelming majority of inter- 
national members are academics 

- Consultants and organization practi- 
tioners are most likely found in Can- 
ada and Asia 

- Members in Canada and Europe are 
most likely (71%, 70%) to hold non- 
U.S. graduate degrees 

©- Members in Asia are most likely 
(75%) to hold U.S. graduate degrees 


- “The Society's mission is to enhance 


human well-being and performance 
in organizational and work settings 
by promoting the science, practice, 
and teaching of industrial- 
organizational psychology”. 


- The SIOP Vision is “To be recognized 


as the premier professional group 
committed to advancing the science 
and practice of the psychology of 
work.” 
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- The first Core Value of SIOP is 
“Excellence in education, research 
and practice of |-O psychology. 


These statements suggest that SIOP is 
providing equal support to I-O practitio- 
ners as it does to academics/ 
researchers, and equal recognition of 
excellence in the practice of l-O psychol- 
ogy. SIOP members seem to widely pro- 
fess support for the science—practice 
integration model for our profession. 
Therefore it seems reasonable to expect 
that practitioners should be valued and 
recognized by SIOP for their work and 
contributions as much as academics/ 
researchers. 


Unfortunately, current reality does not 
seem to match these stated goals. In 
fact, there is a clear pattern within SIOP 
of unequal treatment of I-O practice and 
practitioners in Fellow designations, 
award decisions, and key appointments 
(Silzer & Parson, 2012a). This bias may 
also be finding its way into official SIOP 
language in SIOP’s current definition of 
l-O psychology: “What is |-O?: Industrial- 
organizational (I-O) psychology is the 
scientific study of the workplace” (SIOP 
website, www.SIOP.org). What hap- 
pened to I-O psychology practice? Is the 
bias now being institutionalized? 


In previous articles we have reported on 
SIOP’s track record in awards, appoint- 
ments, officers, and Fellow designations 
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(Silzer & Parson, 2012a; October, 
2012c). Those data documented that l- 
O practitioners are not being adequately 
recognized in these areas. In this article 
we are updating the data for 2012-2013 
to identify any recent progress. 


As we have discussed in previous col- 
umns SIOP professional members were 
categorized into four employment cate- 
gories (based on 2011 membership self- 
report data): 


- Consultants: 30.3% (in consulting 
firms and nonresearch consulting 
positions) 

- Organizational-based professionals: 
19.0% (in organizations & in govern- 
ment positions with a practice fo- 
cus) 

- Academics: 43.5% (in universities 
and colleges) 

- Researchers: 5.1% (in research con- 
sulting firms & government research 
positions) 


An update of these data is reported in 
the SIOP Progress Dashboard found in 
Table 5. 


First it should be noted that SIOP mem- 
bers who are consultants (nonresearch) 
and professionals in organizations are 
49.3% of the SIOP full membership 
(compared to the 48.6% who are aca- 
demics/ researchers), and are 56% of 
the professional members who hold 


Table 5 PhDs in I-O psychology. 


Representation of SIOP Members in 2012-2013 They clearly are a major 
Fellows, Awards, Appointments and Executive Board sector of the member- 
= eee. =. = i Ship: 


SIOP Progress Dashboard 


As the data in Table 5 in- 


peedemics] dicate there has been no 
researchers* . 
2011 membership** 48.60% progress sid little progress 
2011 members with I-O PhDs 44% m Fellow designation, key 
a. appointments, and SIOP 
pce a officers. Only in the 
Awards category has 
201172012 eika there been modest pro- 
2012-2013 82% gress, and this may be 
partially due to awarding 
Awards the 2013 Professional 
Past 84% Contributions Award 
10 awards (what used to be the Pro- 
2011-2012 1 shared award fessional Practice Award) 
875% to two practitioners 
2012-2013 Maweni (instead of an academic/ 
69% researcher). Although 
this award progress is 
Key Appointments *** welcome news, the lack 
2010-2011 80% of progress in general is 
2011-2012 79% discouraging and suggests 
2012-2013 74% an ongoing lack of mem- 
bership representation in 
SIOP Officers SIOP recognitions. 
Past Presidents 2002-2012 80% 
2011-2012 Executive Board 75% 
2012-2013 Executive Board 69% 


SIOP Fellows 


* Inclusion in an employment group was determined by 2011 member self- 
report data As Table 5 indicates there 
** % may not add up 100%, employment focus of some members is unknown has been no progress in 

*** Key appointments were for the 4/2012-4/2013 time period, see Table 6 


for list of appointment groups. recognizing practitioners 
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as SIOP Fellows. This lack of representa- 
tion has not changed over the years, with 
only 17% of Fellows being practitioners 
(the only noticeable exception was in 
2010 when 38% of the newly named Fel- 
lows were practitioners; Silzer & Parsons, 
2012a). It is disappointing that the major 
contributions of senior practitioners in 
organizations and consulting firms seem 
to be seen as undeserving of Fellow desig- 
nation when compared to an early career 
academic who has published a limited 
number of articles in academic journals 
that are largely unread. 


One possible reason for this bias is likely 
that SIOP and the academic decision 
makers who influence these decisions 
do not know how to objectively evaluate 
practitioner contributions in organiza- 
tions and consulting, and have shown 
little interest in outlining appropriate 
evaluation guidelines. An alternative 
Fellow designation for practitioners was 
proposed and quickly dismissed by a 
Fellowship Committee Chair. The resis- 
tance to change and to practitioner rec- 
ognition seems to run deep. 


SIOP Awards 


As Table 5 indicates there has been only 
modest progress in recognizing practi- 
tioners in SIOP awards. A total 31% of 
the awards in 2013 were given to con- 
sultants and professionals in organiza- 
tions. This is a modest improvement 
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over previous years, but it remains to be 
seen if this is sustainable or improved 
upon in 2014. 


Some have suggested that a group of 
insiders have undue influence in SIOP 
affairs (Muchinsky, 2012; Silzer & Par- 
son, 2013a). Compromising personal 
biases have been observed in several 
areas including the SIOP awards process, 
leadership appointments, and the presi- 
dential election balloting procedures. 
Insider members (almost all former SIOP 
presidents and heavily dominated by 
academics) have previously been able to 
personally change the election ballot 
(see Reynolds, Collela, & Salas, 2012), 
inappropriately influence award deci- 
sions, and bias leadership appointments 
in favor of academics. (They also meet 
annually for a dinner restricted to insid- 
ers at the SIOP conference, e.g., the Past 
Presidents dinner). This raises ethical, 
fairness, and conflict of interest issues 
and suggests that SIOP needs to estab- 
lish and follow clear ethical guidelines 
and transparent procedures for these 
decisions. (Recently SIOP did outline 
changes in the election process as a re- 
sult of pressure from the membership 
on the SIOP leadership.) 


It would also seem important that all 
award committees/decision makers 
have a balanced membership represen- 
tation among the committee members 
because these awards can often be de- 
cided by majority vote. In addition SIOP 


has done a poor job in developing 
awards that appropriately recognize 
practitioners’ achievements and contri- 
butions. Even the new award for psy- 
chological assessment contributions was 
given to researchers in 2013, and the 
award guidelines seem to guarantee 
that only researchers will be considered 
in the future. (Award is given to “the 
best refereed journal article or other 
publication that furthers public and pro- 
fessional understanding of individual or 
group assessment in the field,” see SIOP 
website.) 


Part of the problem is the ongoing lack 
of support for practitioners that exists in 
the SIOP Foundation (see below). The 
SIOP Executive board seems to have al- 
most abdicated many of its award re- 
sponsibilities to the Foundation Board, 
which has done little to recognize or 
support I-O practitioners and practice 
(Silzer & Parson, 2013a). Only 
“insiders,” former SIOP presidents, are 
current Board members, so they have 
complete control of all board decisions. 


Key Appointments 


Key appointments in SIOP are a way for 
SIOP to recognize outstanding members 
and to benefit from their expertise and 
experience. The bias against appointing 
practitioners (consultants and profes- 
sionals in organizations) to key appoint- 
ments positions is long standing (see 


Table 5). There has been no progress in 
this area over the years. 


We have demonstrated that practitio- 
ners volunteer for committee work in 
approximately similar proportions as 
other members (Silzer & Parson, 2012a), 
yet the appointment decision makers 
have not fully included or recognized 
practitioners in these appointments. 
Most of these decisions are usually left 
to the discretion of the SIOP presidents, 
so they are in a position to quickly ad- 
dress this inequity if they want to do so. 


A breakdown of the key appointments is 
provided in Table 6. The greatest lack of 
balance occurs in the appointments for 
AOP representatives, Publication Board, 
the Organizational Frontiers Books Edi- 
torial Board, and the SIOP Foundation 
Board. Even the Professional Practice 
Books Editorial Board had 58% aca- 
demic/researcher members and the LEC 
(originally developed for practitioners) 
recently had academics in 67% of the 
chair positions. 


Even 71% of the committee chair posi- 
tions, appointed by the SIOP presidents, 
were filled by academics/researchers. 
This is an example of how SIOP presi- 
dents (dominated by academic insiders), 
when given decision discretion show a 
bias against practitioners. 
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Table 6 


Membership Representation in 2012-2013 SIOP Appointments 


tory of the board always 
being dominated by aca- 


2012-2013 SIOP Appointments 


Academics / 

2011 membership** 48.60% 
2011 members with I-O PhDs 44% 
SIOP Appointments 

Ø SIOP Foundation (n = 6) 83% 

Ø SIOP Representatives to 100% 

AOP (n =4) 

@ Leading Edge Consortium Chairs 67% 

(n =3) 

Ø Publication Board (n =8) 88% 

Ø Book Series Editors (n = 3) 67% 

Ø Professional Practice Books 58% 

Editorial Board (n = 12) 

Ø Organizational Frontiers Books 89% 

Editorial Board (n = 9) 

Ø Fellowship Committee (n = 10) 70% 

Ø Strategic Planning Committee 60% 

(n=5) 

Ø Key Committee Chairs (n = 28) 71% 

74% 


* Inclusion in an employment group was determined by 2011 member self-report 


data 


** % may not add up 100%, employment focus of some members is unknown 


The SIOP Foundation is another good 
example of this lack of practitioner inclu- 
sion. The Foundation’s mission states: 
“The Foundation’s resources are in- 
tended to further the outreach of both 
the practice and the science of I-O psy- 
chology” (SIOP website, www.SIOP.org, 
8-14-13). 


However the Foundation Board has al- 
ways been chaired by, and dominated 
by, academics/ researchers and cur- 
rently all Board members are former 
SIOP presidents (SIOP website, 
www.SIlOP.org, 8-14-13). There is a his- 
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demics /researchers and 
former presidents. The 
board itself nominates 
and votes on their own 
new members, which no 
doubt contributes to the 
unrepresentative Board 
membership. The Foun- 
dation does little to sup- 
port I-O practice or recog- 
nize the contributions of 
l-O practitioners. When 
challenged on this, the 
Foundation has stated 
that they “do not know 
what to do for practitio- 
ners” (Silzer & Parson, 
2013a). Part of the prob- 
lem is that academic/ 
researcher insiders con- 
trol all foundation decisions (including 
their own board membership) and seem 
to have little understanding of the 
needs, interests or contributions of I-O 
practitioners. This is an example of the 
drawbacks of letting a member single 
employment group dominate any Board 
or committee. 


Part of the problem is that senior aca- 
demics are typically the decision makers 
on key appointments. They tend to have 
a strong bias in favor of other academics/ 
researchers, which leads to the gross in- 
equities. Unfortunately several of these 


senior academics (former SIOP Presi- 
dents) have made a career being a SIOP 
officer or chair and as a result have been 
major contributors to the ongoing bias 
against practitioners. Including an equal 
number of Practitioners in these appoint- 
ments seems not only the fair and right 
thing to do, but it is also critical for the 
future of the profession as a whole. 


SIOP Executive Board 


SIOP has made little progress in electing 
an Executive Board that is fully repre- 
sentative of the whole membership (see 
Table 5). Hopefully this will change in 
the future as members, particularly 
practitioner members, realize that hav- 
ing balanced representation on the 
Board is in their own best professional 
interests. 


Conclusions 


SIOP promotes the organization in its 
vision, mission, and values as supporting 
and recognizing the importance of both 
science and practice to the profession. 
Yet it is not balanced or inclusive in its 
recognition and awards. There contin- 
ues to be significant disparity between 
what SIOP says it values and what it rec- 
ognizes. There has been little or no pro- 
gress in including I-O practitioners in 
Fellow designation, Awards and Key Ap- 


pointments, and on the Executive Board. 
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Why does this disparity continue? Per- 
haps the decision makers (academics/ 
insiders), favor their own academic col- 
leagues, have little understanding of I-O 
practice in organizations and consulting 
firms, and know few I-O practitioners 
outside their own academic/research net- 
works. Unfortunately the lack of inclu- 
sion seems to be spreading. We have 
seen this in the I-O Journals where the 
current editors of several journals have 
intentionally created all academic Journal 
Editorial Boards (Silzer & Parson, 2012b). 


If SIOP wants to address this lack of in- 
clusion there are some steps that SIOP 
could take: 


1. Ensure that all SIOP Boards, Commit- 
tees Chairs, awards committees, and 
Key appointments are evenly split 
(50/50) between Practitioners 
(nonresearch consultants and organ- 
izational practitioners) and Academ- 
ics / Researchers. In addition no 
member should be allowed to hold 
more than one key position or ap- 
pointment at one time. 

2. Ensure that practitioners and aca- 
demics/researchers are equally in- 
cluded and recognized (50/50) for 
SIOP Awards and Fellow designa- 
tions. 

3. Have the SIOP presidency alternate 
every year between a practitioner 
and an academic/researcher. This 
should also apply to other significant 


SIOP positions, such as Foundation 
Board Chair, Program Chair, etc. 

4. Establish ethical guidelines and deci- 
sion rules for all award committees 
and decisions. 

5. Establish, promote and deliver ona 
specific set of SIOP initiatives for sup- 
porting and recognizing excellence in 
l-O practice, such as developing objec- 
tive guidelines for evaluating practitio- 
ner contributions. 


Member inclusion issues have been iden- 
tified in the past, but unfortunately SIOP 
presidents have not adequately ad- 
dressed them. At what point will SIOP 
Officers find that these practices are un- 
professional and unfair? We hope that 
will happen soon, while the current Prac- 
titioner members are still in their profes- 
sional careers. 


‘In this article the term “Practitioner” refers to the 50% 
of the membership who are employed in organizations 
or in consulting firms in non-research positions. Some 
academics and researchers may also see themselves as 
practitioners but are included here as academics / re- 
searchers based on their current self reported primary 
employment focus. 

To access a copy of the 2012-2013 SIOP Officers and 
Committee Chairs roster, please click here. 
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Announcing the HRM Impact Awards 


The lifeblood of any profession flows from the creative 
imaginings and timely implementations of bright ideas. 


Here is a bright idea: Reward A while hoping for A. 
r We’ve been hoping for evidence-based human re- 
Foundatio source management practices for some time now, so 


= Spotlight 


let’s try rewarding them. 


A | am delighted to tell you that the first-ever Human 
Resource Management Impact Award winners are— 
a drum roll, please: 


The HRM Impact Award Winners! 


Click anywhere in this paragraph and a new window 
will open to reveal the winners. 


Welcome back to the Foundation Spotlight column if 
you clicked the link paragraph above. If you skipped it, 
take a look. The winners show the best in evidence- 
based human resource management practices. 


íz Because the list of winners was embargoed while this 
K column was being written, | could not tell you about 
the four winners and the honorable mention. But 
thanks to the bright idea of electronic publishing, in- 
clusion of the link gets you both the news about the 


winners and the backstory that | want to tell you in 
this Spotlight column. 


Milton D. Hakel 
SIOP Foundation 
President 


The Backstory 


The story behind the HRM Impact Awards provides an 
illustration of how the SIOP Foundation works to build 
for the future of organizational psychology. The story 
starts with an email from Gary Latham, reporting 
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brainstorming conversations among 
Howard Klein, Rich Klimoski, Wayne 
Cascio and himself, all strong support- 
ers of SIOP. Howard dreamed up the 
basic idea during the Opening Plenary 
session of the Chicago 2011 SIOP Con- 
ference. Gary emailed me an attach- 
ment containing a rough sketch of a 
partnership with SHRM and the SHRM 
Foundation, and said “After you have 
had time to digest it, let’s chat by 


aL 


phone. | think it is a ‘winner’. 


The SIOP Foundation Trustees dis- 
cussed the basic concept for the award 
program and decided to explore it in 
depth. With assent from SIOP’s Execu- 
tive Board, a Steering Committee was 
formed with representatives from 
SHRM, SIOP, the SHRM Foundation and 
the SIOP Foundation. AMemorandum 
of Understanding was drafted, and fol- 
lowing its approval by the four partners 
a year ago, the Steering Committee 
carried on the work of turning the basic 
concept into an operational reality. 


There was a fair amount of uncertainty 
about whether there would be any ap- 
plications for the award. Some specu- 
lated that there would be only three or 
four entries, while | hoped for 100 
(never mind that the logistics of judging 
them would be a nightmare — | think it 
would be a delightful problem to have). 
When the submission deadline arrived 
on July 1, there were 21. All were 
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credible entries. Wayne Cascio, the 
chair of the award committee, de- 
scribed the top seven entries win- 
nowed from the first round of evalua- 
tions as “really fantastic”, and another 
judge described them as 
“phenomenal.” Wayne said, “This 
award program should have been es- 
tablished years ago.” And in what | 
consider to be among the strongest 
kinds of evidence in support of a prac- 
tice, namely, that we use the practice 
on ourselves, Wayne said he will fea- 
ture the winners’ HRM practices in his 
teaching and writing. 


The Next Story 


What is special about SIOP’s partnering 
with SHRM is the opportunity to bring 
the research-based best practice we do 
to the attention of SHRM’s 270,000 
members in 140 countries. 


Imagine a logo like this on your organi- 
zation’s HR website, or your client’s. 


IMPACT AWARD 


Will the HRM Impact Awards program 
contribute to the success of today’s 
global and local work organizations, 
making them better places to work? 

Will it help others to adopt successfully 
implemented, innovative HRM initia- 
tives? Will it eventually take on the hall- 
marks of the Good Housekeeping Seal of 
Approval or the Underwriter’s Laborato- 
ries Certification marks? Only time will 
tell, and you can be certain that a con- 
tinuing flow of bright ideas will be 
needed to make it happen. 


Your calls and questions to the SIOP 
Foundation are welcome. So are your 
bright ideas. So are your year-end tax- 
deductible contributions. The SIOP 
Foundation would like to be among your 
beneficiaries. Join us in building for the 
future. Shine on brightly! 


The SIOP Foundation 

440 E Poe Rd Ste 101 

Bowling Green, OH 43402-1355 
419-353-0032 Fax: 419-352-2645 
E-mail: LLentz@siop.org 


Find your next job 


Find your new employee 
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a Campork 


Your Career 
Takes Flight Here. 


i chenj 


A great place. We can't think of a better way to describe DDI. We help some of the 
world’s most recognizable companies create engaged, high-performing workforces. 
In doing so, we provide our associates with interesting, challenging work and 
development opportunities. Little wonder we’ve been named one of the best 
places to work in America three years running. 


Visit our Careers Center at www.ddiworld.com/careers. 


The Talent Management Expert DDI HP : 


29th Annual Conference: May 15 - 17, 2014 
Preconference Workshops: May 14, 2014 


Robin Cohen 
Conference Chair, SIOP 2014 
Bank of America 


Evan Sinar 
Program Chair, SIOP 2014 
Development Dimensions International (DDI) 


Can you believe it’s time to start plan- 
ning for our annual conference already? 
We were still buzzing with excitement 
from the successful Houston conference 
when we and a few members of our 
conference planning team headed to 
Hawaii in July to check out the facility 
and location (fabulous!) and start plan- 
ning another exciting year full of oppor- 
tunities to learn, network, reconnect, 
and move our field forward (and maybe 
even catch a few rays or ride a few 
waves). 


What do you know about Honolulu? 
Honolulu is one of the most desirable 
vacation spots in the country! It is warm, 
culturally exotic, and completely unlike 
anything else that can be found in the 
United States! We don’t know about you 
but that alone made us want to book 
our trip! And did you know that it is the 
only place in the US with a royal palace? 
Or that Honolulu's home island, Oahu, is 
part of the largest mountain range in the 
world, most of which is under water. 


What about the fact that there are more 
than 100 beaches surrounding Honolulu, 
more than almost any other city in the 
world? Honolulu is also home to one of 
the oldest symphonies in the western 
United States: the Honolulu Symphony, 
formed in 1900. It's also home to the 
world's largest collection of Pacific arti- 
facts, archaeological finds, and items, all 
housed in the Bishop Museum. So, be- 
fore you read any further, mark your 
calendars! The 29™ Annual Conference is 
certainly not to be missed. In this article 
we will give you just the first taste of 
what's in the works as our year of plan- 
ning progresses. Stay tuned for full- 
blown highlights in the January issue of 
TIP. 


The Conference Hotel 


The Hilton Hawaiian Village is located on 
Waikiki’s widest stretch of white sand 
beach and is conveniently located only 3 
miles from downtown Honolulu and 
many popular Oahu attractions. There 
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uled to hit theaters at the same time 
SIOP hits Honolulu, were recently 
filmed on the beach right outside 
the hotel! 
e There is a penguin show in the 
mornings and the Village’s African 
Black-foot penguins eat more than 
3,100 pounds of fish per year. 
Waikiki’s largest pool is at the Hilton 
Hawaiian Village: the 10,000-square- 
foot Super Pool. Plus, Waikiki’s long- 
est resort pool slide is also at the 
Hilton in the Paradise Pool at 77 
feet. 
Nearly 500 palm trees sway at Hilton 
Hawaiian Village. 
Some 2 million guests visit the Vil- 
lage each year, meaning there are 
more than 5 million pieces of lug- 


Hilton Hawaiian Village 


are 22 acres of oceanfront paradise with gage that come through the hotel 
plenty to see and do. During your stay annually. 
you can swim in one of the five pools, e Hilton Hawaiian Village is extremely 
snorkel, kayak, surf, paddle board, take environmentally conscious. They 
a submarine tour and shop until you recycle more than 1,000 tons of 
drop at one of the 90 nearby stores. food each year. This organic waste is 
There are over 18 restaurants and processed and recycled into soil 
lounges, and there is a world class spa amendment, irrigation water, and 
where you can relax and unwind. Some biogas, which is then converted into 
fun facts about the Hilton Hawaiian Vil- electrical energy. 
lage: e The Hilton Hawaiian Village serves 
approximately 136,540 mai tais each 
e The hotel has hosted several televi- year. It also serves about 30,000 
sion shows, including “Hawaiian Blue Hawaii cocktails annually. This 
Eye,” “Hawaii 5-0,” “Beverly Hills means they are ready for SIOP! 
90210,” “Pacific Blue,” and 
“Baywatch Hawaii.” Key scenes 


from the new Godzilla movie, sched- 
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Submissions 


For all of you who submitted proposals 
in response to the Call for Proposals de- 
veloped by Emily Hunter and her CFP 
committee, thank you! The results of the 
peer reviews will be e-mailed in Decem- 
ber. 


Concurrent Sessions: 
Something for Everyone 


The member-submitted, peer-reviewed 
sessions will always be at the heart of 
our conference. We will continue to 
have hundreds of sessions featuring I-O 
psychology research, practice, theory, 
and teaching-oriented content. Presen- 
tations will use a variety of engaging 
formats including symposia/forums, 
roundtable/conversation hours, panel 
discussions, posters, debates, master 
tutorials, and, new this year, an alterna- 
tive session type format for IGNITE and 
other innovative presentation styles. In 
addition, we will have addresses from 
our SIOP award winners, key committee 
reports, and many invited sessions that 
we guarantee you won’t want to miss, 
as they’ve been crafted specifically for 
this year’s conference to delve into the 
progressive and emerging topic areas 
you’ve told us you want to hear more 
about. More on many of these stimulat- 
ing sessions below. 


Invited Sessions 


This year we will feature several invited 
speaker sessions throughout the confer- 
ence, architected by Invited Sessions 
chair Elizabeth McCune and her commit- 
tee. Among the invited sessions this year 
will be an IGNITE session, as well as a 
panel focused on meaningfully defining 
“pig data” and the role I-Os have to play 
in this space. Another panel will discuss 
the co-occurrence of recent mergers and 
acquisitions in the I-O consulting field and 
the increase in the number of start-ups 
building HR-related technology, focusing 
on the impact these developments will 
have on the field of I-O. 


Theme Track 


The program committee is delighted to 
offer another exciting Theme Track, which 
this year has been moved from Thursday 
to Saturday—plan accordingly to be sure 
not to miss it! In line with the broader 
conference theme of Connections, this 
year’s Theme Track is titled 
“Breakthrough: Explaining l-O Psychology 
Through Connection.” This full day of pro- 
gramming will focus on breakthrough 
ideas that were achieved by connecting 
with areas or approaches outside of main- 
stream I-O. As a breakthrough on our 
part, we are adopting a unique type of 
session format for the theme: “TEDstyle” 
talks! 
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Chair Kristen Shockley and her commit- 
tee are in the process of assembling an 
outstanding group of dynamic speakers to 
present the talks. The day will include a 
focus on connections in five specific areas. 
The East Meets West speakers will pre- 
sent evidence that understanding cultural 
differences and effectively managing 
these differences can contribute to indi- 
vidual, team, and organizational effective- 
ness. In the Inductive Meets Deductive 
Reasoning session, the speakers will dis- 
cuss of how these different research para- 
digms can jointly facilitate breakthrough 
discoveries. Business Meets Psychology 
will focus on the connections that psy- 
chologists and business practitioners can 
make to enhance how they work together 
to help companies achieve greater suc- 
cess. The Neuroscience Meets Leadership 
session will explore how neuroscience 
and cognitive psychology can be applied 
to enhance our understanding of effective 
self- and other-leadership behaviors. Fi- 
nally, Technology Meets Application will 
include demonstrations of new technol- 
ogy that can greatly advance our research 
and practice as well as insights into the 
challenges of successful technology adap- 
tation. Each session will feature 2-3 
speakers and time for attendee participa- 
tion. Stay all day (and earn the opportu- 
nity for continuing education credits) or 
attend only the sessions of most interest 
to you. 
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Friday Seminars 


Friday Seminars, the only extended-length 
sessions on the program, offer a unique 
educational opportunity within the body 
of the conference. These 3-hour sessions 
scheduled on Friday (two in the morning, 
two in the afternoon) delve deeply into a 
rotating set of topics chosen anew each 
year. They provide a rich immersion ex- 
perience for attendees about key content 
areas. Come to expand your toolbox and 
enlarge your knowledge base. Presented 
by true content experts and designed 
around learning objectives to meet the 
professional development goals of atten- 
dees—those who are new to and familiar 
with the topics alike—Friday Seminars also 
offer continuing education credits. Please 
note that Friday Seminars require advance 
registration and an additional fee. This 
year, the Friday Seminars committee led 
by Silvia Bonaccio has prepared sessions 
on the following topics: 


Topic: MPlus 
Speaker: Robert Vandenberg 


Topic: Management and Culture 
Speakers: Gilad Chen and Bradley 
Kirkman 


Topic: Physiological Measurement 
Speaker: Jayanth Narayanan 


Topic: Generational Differences and 
Their Implications for the Workplace 
Speakers: Jean Twenge and Stacy 
Campbell 


Master Collaboration 


Each year, the Program Committee cre- 
ates a Master Collaboration session to 
connect leading researchers and practi- 
tioners on a topic to share their outlooks 
and to advise the audience on how to 
recognize and remedy key science— 
practice gaps through improved under- 
standing of and alignment on a content 
area well-suited to vigorous and eye- 
opening dialogue. This year’s Master 
Collaboration committee, led by Hailey 
Herleman, is developing a session on 
the topic of “Technology based Simula- 
tions for Selection: Identifying Gaps Be- 
tween Research and Practice and Setting 
a Future Agenda.” Two academic and 
two practitioner perspectives will be 
paired with an integrative discussion 
and audience participation segment led 
by Nancy Tippins. 


Communities of Interest 


Looking for a SIOP forum that is infor- 
mal, insightful, and encourages audience 
participation? Communities of Interest 
allow you to meet new people, discuss 
new ideas, and have an active role at the 
forefront of a hot topic in I-O. There will 
be 10 outstanding Community of Inter- 
est (COI) sessions this year, specially de- 
signed to create new communities 
around common themes or interests. 
The sessions have no chair, presenters, 
discussant, or even slides. Instead, they 


are a casual discussion informally mod- 
erated by one or two facilitators with 
insights on the topic. These are great 
sessions to attend if you would like to 
meet potential collaborators, generate 
ideas, have stimulating conversations, 
meet some new friends with common 
interests, and develop an informal net- 
work with other like-minded SIOP mem- 
bers. Christopher Cerasoli and the rest 
of the COI Committee have already lined 
up some great sessions and facilitators: 


Beyond Science: I-O to Inspire 
(Facilitators: Lacie Barber and Mindy 
Shoss) 
Employee Motivation and Engage- 
ment (Facilitators: John Donovan 
and Christine Corbet) 
l-O in Healthcare Organizations 
(Facilitator: Sylvia Hysong) 
Relationships in I-O (Facilitators: 
Daisy Chang and Mark Poteet) 

- Social Media for Inference and Se- 
lection (Facilitators: Jamie Winter 
and Mike Zickar) 


Additional topics for this year’s COI ses- 
sions include: 


- Evidence Based Practice 

- Assessment Gamification 

- Big Data in I-O 

- New Practitioners and Academics 

- |-O: What We Can Offer to the 
Armed Forces and Veterans 
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For more information about these ses- 
sions, reach out to the chair of the Com- 
munities of Interest committee, Christo- 
pher Cerasoli. 


Continuing Education Credits 


The annual conference offers many op- 
portunities for attendees to earn con- 
tinuing education credits, whether for 
psychology licensure, HR certification, or 
other purposes. Information about the 
many ways to earn CE credit at the SIOP 
annual conference can be found at 
http://www.siop.org/ce and will be con- 
tinually updated as more information 
becomes available. 


Closing Plenary and Reception 


The 29th Annual Conference will close on 
Saturday afternoon with a plenary ses- 
sion that includes a very special invited 
keynote speaker (stay tuned!) and the 
announcement of incoming President 
José Cortina’s plans for the upcoming 
year. After the address, we’ll close out 
the conference with a Hawaiian-style 


celebration not to be forgotten. Do you 
usually take off early on Saturday and 
miss the big finale? Perhaps this is the 
year to see the conference through to 
the close and head out the next morning 
or even after few more days in Honolulu 
or on one of the other great islands. 


Making Your Reservation 


Please see the SIOP Web page for details 
on booking your room. We encourage 
conference attendees to come early and 
stay late and enjoy all that Hawaii and 
the SIOP conference have to offer! 


It’s only October when this goes to 
press, but we hope we’ve sparked your 
excitement for SIOP 2014 and Hawaii. 
We can’t wait to see you there! Aloha! 


A 
Ò 


SIOP#2014 


MAY 15-17, 2014 * HONOLULU, HAWAII 
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From the SIOP LGBT Ad-Hoc Committee: 
The Repeal of DOMA: 
A Brief History, and Moving Toward Workplace Equality 


Thomas Sasso 
University of Guelph 


Katina Sawyer 
Villanova University 


Larry R. Martinez 
The Pennsylvania State University 


In the past few months there has been 
an abundance of media attention given 
to the overruling of Section Three of the 
Defense of Marriage Act by the United 
States Supreme Court. This momentous 
court decision has had a significant posi- 
tive impact on the marriage equality 
movement in the United States and fur- 
ther promotes the principles of social 
equality for members of the lesbian, 
gay, bisexual, and transgender (LGBT) 
communities. Not only is this judicial 
ruling directly aligned with the ethical 
principles of the APA, but it also has di- 
rect implications relevant to industrial- 
organizational psychology professionals. 
In this article, we will explain the history 
of the Defense of Marriage Act’s imple- 
mentation and then examine the over- 
turning of Section Three in relation to 
the workplace context. We close by dis- 
cussing the future steps industrial- 
organizational psychology professionals 


can take to promote greater workplace 
equality for LGBT employees in the wake 
of this recent ruling. 


What Was DOMA? 


Background 

In 1996 the Defense of Marriage 

Act (DOMA) was introduced into the 
House of Representatives and the Sen- 
ate. The act contained two key provi- 
sions. Section Two reserved authority 
over marriage to the individual states, 
such that any decision by one state to 
allow same-sex marriage would not re- 
quire other states to recognize those 
relationships. Section Three of DOMA 
established that “marriage” would refer 
solely to relationships of one man with 
one woman, and the term “spouse” (or 
similar terms in previous and future leg- 
islation) would refer to a husband and 
wife of the opposite sex. 
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The legislation received overwhelming 
support in both the House of Represen- 
tatives and the Senate, and passed by 
margins that would override any veto 
attempts by President Bill Clinton. In 
September of 1996, the act was signed 
into law. In subsequent years, as individ- 
ual states passed marriage equality laws, 
DOMA’s impact became apparent to 
same-sex couples. Although same-sex 
couples were recognized within their 
states, they were not recognized by the 
federal government; therefore, legally 
married couples were denied many fed- 
eral benefits and protections provided 
to opposite-sex couples. 


During his first presidential campaign, 
Barack Obama’s platform supported a 
repeal of DOMA. In 2011, President 
Obama instructed the Department of 
Justice to cease defending Section Three 
of DOMA, which he claimed was uncon- 
stitutional because it discriminated 
against legally married individuals of 
sexual orientation minority status. This 
action led to the development of the 
Bipartisan Legal Advisory Group (BLAG) 
of the House of Representatives to con- 
tinue to defend Section Three of DOMA 
in court, replacing the Department of 
Justice. 


Relevant DOMA Court Cases 

A number of lawsuits have been filed 
challenging the constitutionality of 
DOMA, specifically focusing on the defini- 
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tion of marriage. For the purpose of un- 
derstanding the effects of DOMA we will 
focus on three of these cases. 


The lawsuit of Golinski v. Office of Per- 
sonnel Management (2012) was filed 
because Golinski could not receive 
health benefits from her employer (the 
Ninth Circuit Court of Appeals) for her 
wife. Similarly, in Gill v. Office of Person- 
nel Management, the plaintiffs argued 
that various benefits that were offered 
to opposite-sex spouses had been de- 
nied to same-sex spouses. These in- 
cluded health, retirement, and social 
security benefits, in addition to the abil- 
ity to file federal taxes as a married cou- 
ple. Numerous other cases also chal- 
lenged DOMA’s implications for immi- 
gration, bankruptcy, and military and 
veteran affairs. In many of these cases 
the courts found DOMA to be unconsti- 
tutional based on individuals’ right to 
equal protection set in the Fifth Amend- 
ment of The Constitution. 


Although many cases challenging DOMA 
were appealed to higher courts by BLAG 
unsuccessfully, the Supreme Court of 
the United States agreed to hear the 
case of United States v. Windsor (2013). 
In this case Edith Windsor had been re- 
quired to pay $363,000 in federal taxes 
on the inheritance from her deceased 
spouse because the federal government 
did not recognize the marriage. The Su- 
preme Court, in a 5—4 decision, ruled 


that Section Three of DOMA was uncon- 
stitutional. As a result of this decision, 
the federal government must recognize 
marriages between gay or lesbian cou- 
ples married in states where same-sex 
marriage is legal and offer all federal 
protections and benefits to these cou- 
ples. Thirteen states currently recognize 
marriage equality: California, Connecti- 
cut, Delaware, lowa, Maine, Maryland, 
Massachusetts, Minnesota, New Hamp- 
shire, New York, Rhode Island, Vermont, 
Washington, and the District of Colum- 
bia. 


How Did DOMA Affect the Workplace? 


In the midst of the United States v. Win- 
dsor (2013) case, 278 employers and 
organizations joined together in the 
Business Coalition for DOMA Repeal. 
This coalition included such corporations 
as Amazon.com, Google, Johnson & 
Johnson, Microsoft, and Starbucks. The 
coalition made two primary arguments 
regarding the negative effects of DOMA 
on organizations. 


First, the coalition argued that DOMA 
created a burden upon employers. Un- 
der the enforcement of DOMA, private 
organizations were entitled to provide 
employment benefits to employees’ 
same-sex partners, but these couples 
were still encumbered with discrimina- 
tory tax burdens. For example, the cost 
of healthcare benefits for employees’ 


same-sex partners was treated as tax- 
able income, but the benefits for em- 
ployees’ opposite-sex partners were not 
taxable. Employees with opposite-sex 
partners could also pay for their part- 
ner’s healthcare benefits on a pre-tax 
basis, while this option was not available 
for employees with same-sex partners. 
Similar tax differences also applied to 
childcare, elder care, retirement, contin- 
ued healthcare after termination, and 
implementation of the Family Medical 
Leave Act. These differences often re- 
sulted in varying levels of take-home pay 
and financial stability among employees, 
solely due to the sex of their spouses. As 
a result of increased taxation for same- 
sex partnered employees, some organi- 
zations took it upon themselves to 
“work around” the barriers created by 
DOMA with higher salary or other com- 
pensatory means in order for these em- 
ployees to maintain equality with their 
heterosexual counterparts. Although 
this was a positive benefit for LGBT em- 
ployees, it also placed greater financial 
and administrative burdens on organiza- 
tions that were committed to maintain- 
ing fair and nondiscriminatory employee 
compensation practices (relative to 
those who were not). 


Following the Supreme Court ruling on 
Section Three, federal law now ensures 
that legally married same-sex couples 
are entitled to spousal health insurance 
and retirement benefits in organizations 
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where spousal benefit plans are offered. 
This also prevents the benefits from be- 
ing deemed a taxable income and will 
remove the financial burden on organi- 
zations that were previously compensat- 
ing married same-sex employees for 
their additional tax burden. 


Second, the coalition argued that DOMA 
forced employers to discriminate against 
their employees, conflicting with their 
organizational missions or policies (and 
often conflicting with state, county, or 
municipal laws as well). These conflicting 
levels of legislation put employers who 
enforced federal DOMA regulations in 
locations that recognized same-sex mar- 
riages at an increased risk for litigation. 
DOMA also placed the burden of enforc- 
ing discriminatory practices on the organi- 
zations themselves and on individual hu- 
man resources employees, many of which 
were not versed in the advanced constitu- 
tional rhetoric necessary to explain the 
legal and tax-related implications to their 
constituents. As noted in their brief, the 
act “forces us to discriminate against a 
class of our lawfully-married employees, 
upon whose welfare and morale our own 
success in part depends” (United States v. 
Windsor, 2013). 


Next Steps for LGBT Workplace Equality 
The Supreme Court’s ruling is monumen- 


tal and has practical implications that af- 
fect both employers and employees. 
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However, it is important to note that the 
overturn of Section Three of DOMA does 
not ensure marriage equality across the 
United States, nor does it provide any 
workplace protections for LGBT employ- 
ees. In states where same-sex marriages 
are not legally recognized, employees in 
same-sex relationships may still be re- 
fused the federal benefits and protections 
afforded to opposite-sex couples because 
Section Two of DOMA (which states that 
individual states do not have to recognize 
same-sex marriages performed in other 
states) is still in effect. Furthermore, with- 
out the passage of The Employment Non- 
Discrimination Act (ENDA), LGBT employ- 
ees may still be discriminated against in 
the workplace without legal recourse. 


Thus, although the repeal of Section 
Three of DOMA is an important step in 
achieving equality, LGBT advocates— 
and industrial-organizational psycholo- 
gists in particular—must continue to 
support the passage of ENDA. Currently 
there are not any federal protections 
against employment discrimination of 
LGBT individuals, and 29 states that do 
not prohibit sexual orientation discrimi- 
nation in the workplace. Furthermore, 
33 states do not have legislation pro- 
tecting against workplace discrimination 
related to gender identity. However, 
ENDA has been introduced into Con- 
gress and would extend federal protec- 
tions against discrimination to include 
sexual orientation and gender identity. 


ENDA would apply to Congress, federal, 
state, and local government employees. 
In September 2012, SIOP passed an offi- 
cial statement supporting ENDA, and it is 
imperative that we as both a profes- 
sional organization and as individuals 
continue to actively support the passage 
of this legislation. 


It is important to realize that there is a 
great deal of uncertainty around the 
treatment of same-sex couples who 
were legally married in one state and 
then moved into a state where same-sex 
marriage is not legal. It is anticipated 
that in the coming months there will be 
greater clarity as to how this unequal 
treatment across state lines will be recti- 
fied, either through future legislation or 
judicial direction. In the meantime, or- 
ganizations and employees will need to 
monitor upcoming legislative decisions 
closely and potentially seek independent 
legal advice regarding individual cases. 


Conclusion 


Overall, the repeal of Section Three of 
DOMA is a positive step toward equality 
for LGBT individuals in the workplace. 
However, in order to achieve true equal- 
ity, federal protections must be granted 
to LGBT employees at work, and states 
must adopt fair policies for same-sex 
marriages. Thus, the fight for equality is 


not yet over, and advocates for LGBT 
workplace rights must continue to strive 
toward a better future for LGB employ- 
ees. As an organization, SIOP supports 
ENDA, and we hope that its membership 
will consider actively supporting work- 
place equality for LGBT employees as 
well. 


If you have questions about DOMA, 
ENDA, or the legislation discussed in this 
piece, please contact: Thomas Sasso: 


tsasso@uoguelph.ca, Katina Sawyer: 
katina.sawyer@villanova.edu, or Larry 
Martinez: martinez@psu.edu. 


If you have questions about how you 

can get involved in SIOP’s LGBT Ad-Hoc 
Committee, please contact Larry Marti- 
nez (Chair of the LGBT subcommittee): 


martinez@psu.edu. 
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The EuroPsy Specialist Certificate in 
Work and Organizational Psychology 


Wendy S. Becker 
Shippensburg University 


Salvatore Zappala 
University of Bologna 


From May 22-25, 2013, | attended the 
European Association of Work and Or- 
ganizational Psychology (EAWOP) Con- 
gress in Munster, Germany, along with 
more than 1,400 psychologists, including 
several dozen SIOP members. The bian- 
nual EAWOP Congress began in 1983; 
today it is the largest international con- 
ference on work and organizational psy- 
chology in Europe with more than 50 
countries represented. A central part of 
EAWOP’s mission is the interaction be- 
tween scientists and practitioners. Nota- 
bly, the theme of the 16" Congress was 
“Imagine the future world: How do we 
want to work tomorrow?” 


Dr. Salvatore Zappala, University of Bolo- 
gna, facilitated a description of the Euro- 
Psy Specialist Certificate in Work and Or- 
ganizational Psychology; we briefly de- 
scribe it here. The EuroPsy (or European 
Certificate in Psychology) was launched 
and is managed by the European Federa- 
tion of Psychologists’ Associations (EFPA) 
to provide a common standard of compe- 
tence of professional training and aca- 
demic education in psychology. It envi- 
sions and aims to facilitate a free move- 
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ment of psychologists across the coun- 
tries of the European Union by setting a 
common benchmark standard. The main 
purposes of EuroPsy are: 


e to guarantee to clients and employ- 
ers a level of education, professional 
competence, and ethical conduct by 
psychologists that are awarded the 
EuroPsy; 

e to facilitate the mobility and cross- 
border services of psychologists; and 

e to give psychologists an opportunity 
to obtain continuing and specialized 
education throughout Europe. 


Thus, any psychologist who meets the 
standard of a university education in 
psychology of at least 5 years and at 
least 1 year of supervised practice can 
obtain the Basic EuroPsy Certificate and 
be included in the Register of European 
Psychologists. The Basic certificate sets 
the standard with regard to professional 
practice, normally in one professional 
context, at the point of entry into the 
profession. The professional contexts or 
areas of practice currently recognized by 
Basic EuroPsy are: 


- Work and organizational psychology 
(WOP) 

- Clinical and health psychology 

- Educational psychology 

- Other contexts 


After entry into the profession, it is as- 
sumed that psychologists continue their 
professionalization by refining their 
knowledge, and developing and improv- 
ing their competences in a specific area 
of practice. Thus two Specialist Certifi- 
cates have been developed; one in the 
Psychotherapy field and the other one, 
developed by EAWOP, in Work and Or- 
ganizational Psychology. These certifi- 
cates, which are an “add-on” to the Ba- 
sic Certificate, establish minimum re- 
quirements in terms of education, train- 
ing, and competences, developed by a 
practitioner after graduation and during 
his or her practice. 


A pilot test of 74 applicants for the WOP 
certificate from five countries (Finland, 
Norway, Spain, UK, and Italy) was con- 
ducted during the second half of 2012. 
The goal of the pilot test was (a) to assess 
the feasibility of the certificate for work 
and organizational psychologists, (b) to 
assess whether the requirements for the 
certificate can meet local/national cir- 
cumstances, and (c) to identify what re- 
mains to be done. Two types of routes for 
applicants were considered: a regular 
(traditional) route for recent graduates (in 
other words, the typical candidate is an 


applicant that, after having obtained the 
EuroPsy Basic, and after at least 3 years of 
practice, additional education, supervised 
practice and evidence of adequate com- 
petences, applies for this certificate) and 
a grandparenting route for applicants that 
have graduated more than 5 years ago 
and who have at least 5 years of full-time 
practice in the last 10 years. 


Good practices are already available in 
some European countries, but the pilot 
test identified the need to improve post- 
graduate learning activities and make 
them more structured and available to 
practitioners. Up to 60 European credits 
(ECTs) of postgraduate learning activities 
are in fact needed to obtain the certifi- 
cate, as well as 30 ECTS of applied re- 
search, interventions, assessments, and/ 
or evaluations at the individual, group, 
or organization level. Continuing profes- 
sional development can include attend- 
ing accredited courses, seminars, and 
conferences; coauthoring or editing a 
professional paper; presenting to a pro- 
fessional audience; and/or developing 
new skills at work. 


The pilot test also identified the need to 
define supervision and coaching more 
coherently with I-O psychology. Also 
identified was the difficulty assessing 
and grading competencies, both by prac- 
titioners and the supervisors. In sum- 
mary, the pilot test committee stated 
that the assessment of professional 
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competencies for psychologists is deli- | wide. There is much more information 

cate and challenging! about the EuroPsy WOP on EFPA’s web- 
site (www.efpa.eu/) and on EAWOP’s 

The next step for the WOP specialist cer- website (www.eawop.org/). 

tificate is to launch the project Europe 


SIOP 29th Annual Conference 


Honolulu, Hawaii 
May 15-17, 2014 
Hilton Hawaiian Village 
and 
The Hawaii Convention Center 


Combining cutting- 
edge technology with 
authentic Hawaiian 
ambience 


The legendary spirit 
of aloha encourages —W— 
attendees to see the 
world in a new light, 
so it’s no surprise —_— 
that people 
accomplish more Ma 
when they meet here. 


Item/Variable N Freq % N Fri 
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News From the SIOP-United Nations Team 


SIOP Representatives to the United Nations: 
John C. Scott 
Ishbel McWha 
Mathian Osicki 
Deborah E. Rupp 
Lise Saari 
Lori Foster Thompson 


One of the key goals of SIOP’s UN team 
is to bring l-O thought leadership to bear 
in addressing key challenges to the 
United Nations agenda. Toward that 
end, the UN team can act as a clearing- 
house of sorts to assemble “rapid- 
response teams” from SIOP membership 
to respond to UN calls for assistance in 
areas aligned with our expertise. This is 
one of the ways in which SIOP can have 
a voice in international policy making 
and build awareness of our knowledge 
and skill set with the hope of promoting 
positive social change at a global level. 


To illustrate, a UN working group was 
recently tasked with developing a pro- 
posal to the General Assembly for tangi- 
ble, actionable work/initiatives/ 
interventions that address the UN's goal 
to promote and protect the rights and 
dignity of older persons. As part of this 
effort, this working group put out a call 
for input from nongovernmental organi- 
zations (NGOs) via statements that ar- 
ticulate what knowledge we have accu- 
mulated on this issue and what it sug- 


gests for policy intervention. A group of 
SIOP experts was quickly assembled to 
produce a statement regarding the work 
-related rights and dignity of older per- 
sons. This statement, which was written 
by Lisa Finkelstein, Donald Truxillo, 
Franco Fraccaroli, and Ruth Kanfer can 
be found on the SIOP United Nations 
Team group page on my.SIOP (stored in 
the “library”). 


We hope to increase the frequency and 
scope of these rapid-response teams to 
drive the development of statements 
such as this one. In addition to directly 
serving the advocacy, international, and 
UN-related mission of SIOP, this can also 
open the door for special projects with 
UN agencies, member states, and other 
NGOs within SIOP members’ areas of 
expertise. Please be on the lookout for 
calls for proposals for UN projects. 
These will be posted on our my.SIOP 
group page, as well as via SIOP News- 
briefs and TIP. 
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New Representatives 


We would like to welcome two new 
New York-based representatives to the 
SIOP UN Team, Lise Saari (NYU, Baruch) 
and Mathian (Mat) Osicki (IBM). Both 
have significant international experience 
and have hit the ground running! Ishbel 
McWha, who has been serving on our 
New York-based team, has moved to 
Edinburgh, Scotland, and as such will 
soon be our first Europe-based repre- 
sentative, working toward the building 
of our Geneva-based team. We would 
also like to welcome our first SIOP-UN 
intern, Drew Mallory, who has just com- 
pleted a master’s degree from Oxford 
and will be completing his PhD in I-O 
Psychology from Purdue University. He 
also brings to our team a great deal of 
international, humanitarian, and profes- 
sional experience. 


Elections 


Lori Foster Thompson was recently 
elected cochair of the 2014 Psychology 
Day at the United Nations. This is an 
annual event sponsored by psychology 
organizations that have NGO status with 
the UN Department of Public Informa- 
tion (DPI) and the UN Economic and So- 
cial Council (ECOSOC). The event offers 
UN staff, ambassadors, and diplomats; 
NGO representatives; members of the 
public and private sectors; students, in- 
vited experts, guests, media and other 
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stakeholders the opportunity to learn 
what psychologists contribute to the 
United Nations, to exchange ideas, and 
to establish partnerships on global is- 
sues. This year’s topic is sustainable de- 
velopment. Lori’s cochair is Rashmi Jai- 
pal from the APA. 


John Scott was recently elected as chair 
of the Psychology Coalition at the United 
Nations (PCUN). This coalition is com- 
posed of psychologists who represent 
NGOs accredited by the UN and psy- 
chologists affiliated with United Nations 
departments, agencies, and missions. 
Members of the Coalition collaborate in 
the application of psychological princi- 
ples, science, and practice to global chal- 
lenges faced by the UN in carrying out 
its mission, which include the Millen- 
nium Development Goals. The Coalition 
seeks to accomplish this overarching aim 
through advocacy, research, education, 
and policy/program development 
guided by psychological knowledge and 
perspectives to promote human dignity, 
human rights, psychosocial well-being, 
and a decent work agenda. 


UN Global Compact Update 


We continue to work closely with the 
UN Global Compact in the promotion of 
organizational principles that promote 
human rights, fair labor standards, envi- 
ronmental sustainability, and anticor- 
ruption measures. We reported in the 


April issue of T/P that SIOP has become 
an official participant of the Global Com- 
pact. We are currently working ona 
campaign to assist SIOP members in ad- 
vocating to their employer to join the 
Global Compact. There are ways that all 
sorts of employers—academic, corpo- 
rate, and public sector—can participate. 
We are presently assembling a database 
of current SIOP members whose em- 
ployers have already joined. We may be 
reaching out to these individuals for sup- 
port as we launch this campaign. In the 
meantime, if you would like to get in- 
volved, or report what your employer is 
doing in relation to the Global Compact 
principles, please contact Deborah Rupp 


(ruppd@purdue.edu). 


Aligning With the International Labour 
Organization (ILO) 


The SIOP UN team has been meeting 
with I-O psychologist Telma Viale, Spe- 
cial Representative to the UN and Direc- 
tor of the International Labour Organiza- 
tion (ILO) Office in New York. The ILO is 
a specialized agency of the United Na- 
tions devoted to promoting social justice 
and internationally recognized human 
and labor rights. Ms. Viale presented at 


SIOP 2013 as part of a Friday seminar 
where she highlighted how I-O psycholo- 
gists’ expertise aligns with the ILO’s de- 
cent work agenda and pursuit of a global 
green economy. This UN team, led by 
Lori Foster Thompson, has been working 
to identify key areas in which I-O psy- 
chologists can contribute value to the 
ILO and its global agenda. 


Cross-Divisional APA Presentation 


A cross-divisional symposium, entitled 
Promoting International Human Rights: 
Advocacy of Psychologists at the UN, 
was recently held at APA and chaired by 
John Scott. This symposium, which was 
sponsored by APA Divisions 14, 9, 13, 
17, 27, and 48, and American Psycho- 
logical Association of Graduate Students 
served to highlight SIOP’s and other APA 
divisions’ initiatives at the United Na- 
tions, including Psychology Day and ac- 
tivities that connect psychological sci- 
ence to human rights. 


1 NGOs, which can be quite literally the UN's 
"consultants" in developing initiatives and policies. SIOP 
is one such NGO. 

? Our NGO status allows for teams based out of New 
York, Vienna, and Geneva. 
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APA Council of Representatives Meeting 


Deborah L. Whetzel 
Human Resources Research Organization 


John Scott, Rodney Lowman, Lori Foster 
Thompson, and Deb Whetzel attended 
the 2% day Council of Representatives 
(COR) sessions at the APA Convention 
August 1 and 4 in Honolulu, HI (yes, it’s a 
tough job, but somebody has to do it!). 
A number of significant actions of inter- 
est to SIOP members were taken: 


e The revised Standards on Educa- 
tional and Psychologists Tests were 
approved. After 6 years in the mak- 
ing, the Standards will soon be pub- 
lished by APA, NCME, and AERA. 


The proposed Guidelines for the 
Practice of Telepsychology were ap- 
proved. We partnered with Division 
13 (Consulting Psychology) to re- 
spond to an initial set of Guidelines. 
This is particularly relevant to those 
of you who do consulting (e.g., ex- 
ecutive coaching) by phone and you 
should get a final copy from APA. 


The Policy related to Psychologists’ 
Work in National Security Settings 
and Reaffirmation of the APA Posi- 
tion against Torture and Other 
Cruel, Inhuman or Degrading Treat- 
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ment or Punishment was passed by 
an overwhelming majority. 

As described in previous APA COR 
write-ups, the Good Governance 
Project (GGP) has been working on 
ways to make the Council more nim- 
ble in responding to important con- 
temporary issues of policy and key 
administrative decisions of APA. To 
move the process along, the Board 
of Directors proposed a series of 
motions that were put to a vote. The 
motions and results are described 
below: 


e Motion 1: Support enhanced use 
of technology to engage members 
and provide increased opportunity 
to do the work of governance in 
addition to face-to-face meetings 
(99% in favor) 

e Motion 2: Support development of 
a leadership program focused on 
training for governance as well as 
leadership in the general APA 
community (95% in favor) 

e Motion 3: Create an APA-wide 
governance triage system to ad- 
dress new and emergent issues in 
a timely and comprehensive fash- 


ion without duplicative effort (86% 
in favor) 

Motion 4: Council will expand its 
scope to also focus on directing 
and informing policy and ensuring 
APA policies are aligned with 
APA's mission and strategic plan. 
(89% in favor) 

Motion 5: Support delegating au- 
thority for areas of fiduciary re- 
sponsibility to the Board of Direc- 
tors on a trial basis for a 3-year 
period following implementation 
(68% in favor) 

Motion 6: Change Board composi- 
tion to include six members-at- 
large, four members elected by 
Council, one elected by APAGS, 
three in the Presidential cycle, and 
one appointed by the Board. (59% 
in favor)o 

Motion 7: Agree that a substantive 
change in Council structure is 
needed to be effective in the fu- 
ture (59% in favor). We then had 
options to vote on regarding struc- 
ture that ranged from a pillar 
model (15 seats for each of 6 pil- 
lars: education, science, public 
interest, practice, health, and ad- 
vocacy; N = 90), which would have 
no specific division representation 
to models that included one seat 
per division and SPTA (N = 114) 
plus additional seats representing 
various other interests. We had a 
straw vote (which does not count 


as a “real” vote) and the pillar re- 
ceived 19% support and the other 
models received 38-41% of the 
vote. So, the implication for SIOP 
is that we may lose three of our 
four seats on Council, but we will 
not lose all seats. 

Motion 8: Council directs the 
President to appoint an Imple- 
mentation Working Group (IWG) 
made up of 15-20 individuals to 
develop implementation and tran- 
sition plans for governance 
changes that Council adopts. (91% 
in favor) 


e Although some of these decisions 
are “no brainers” (who’s going to 
vote against enhanced use of tech- 
nology?), it is interesting that Coun- 
cil voted on pretty radical change. 
You might wonder how a 90- or 
114+ member Council is going to be 
particularly nimble, and we had the 
same question. But, there is a lot of 
hesitation regarding the loss of seats 
at Council. So, bottom line here is 
that at some point, Division 14 
(SIOP) may lose some seats on Coun- 
cil, but APA should become more 
nimble and able to respond ina 
more timely way to issues of impor- 
tance. 


Council approved the 2014 APA 
budget of $110.6 million in revenues 
and $107.6 in expenses. APA publi- 
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cations and databases generate $85 other APA division’s initiatives at the 


million in revenue annually. United Nations. 
e Of note, two Division 14 members 
are running for APA President, Kurt e Rodney Lowman participated in sev- 
Geisinger and Rodney Lowman. eral sessions including convention 
survival techniques for newcomers, 
e John Scott chaired a symposium Pro- and fundamentals and ethical and 
moting International Human Rights: legal concerns in consulting psychol- 
Advocacy of Psychologists at the UN ogy, including telepractice and 
that served to highlight SIOP’s and coaching. 


The SIOP Internship page has 
been completely revamped! 
See the new look HERE! 


The External Award page has been 
updated to provide members with the best 
information on awards and grants available to I-Os. 


Click HERE for access! 
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Update About the New APA Convention Structure and 
Opportunities for SIOP Members to Get Involved 


Autumn Krauss, Sentis 
APA Program Chair 


In my last update, | discussed the fact that 
some changes were afoot for the APA 
convention starting in 2014. The main 
gist of these changes is that the APA rec- 
ognized a need for more integrated cross- 
divisional programming at the APA con- 
ventions. The goals of this integration are 
to highlight that we are all psychologists 
first and acknowledge that many topics 
within psychology are best understood 
from the lens of multiple psychological 
specializations. | don’t know about you, 
but | found this new focus for the APA 
convention exciting for SIOP. From my 
perspective, this new structure aligns well 
with our goals to expand our influence 
and build more connections within the 
field of psychology. 


So, here is the update on my last update 
as to where the 2014 Convention is 
heading: 


e Anew process was created whereby 
proposed cross-divisional sessions 
are submitted to an APA Central 
Programming Group (CPG). These 
sessions need to be endorsed by at 
least two divisions and should re- 
flect cross-cutting subject matter. 


After the CPG considered several 
themes for this collaborative pro- 
gramming, they arrived at the ones 
below. Although these will receive 
special consideration during the 
cross-divisional submission process, 
submissions can be on any psycho- 
logical topic. It is the responsibility 
of our committee to collaborate 
with other divisions to submit com- 
petitive sessions to the CPG, with 
the deadline to do so being Novem- 
ber 22, 2013. 


1. Psychology and the Public Good 
2. The Psychology of Violence 

3. Psychology and Technology 
4 


. Healthcare Integration and 
Reform 


5. Mechanisms and Principles of 
Change 


6. Internationalizing Psychology 


7. Controversies and Difficult 
Dialogues in Psychology 


8. Lifelong Training and 
Development of Psychologists 
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e By the time you are reading this, the 
APA 2014 Call for Convention Pro- 
posals will be available, so go find it 
and read it and consider submitting 
to the APA Convention. Submis- 
sions are due December 2, 2013, 
with the convention occurring Au- 
gust 7-10, 2014. We recognize that 
conference budgets are limited and 
attendance at the APA convention is 
often prioritized below some of our 
other conferences like SIOP and 
AOM. In 2014, the convention will 
be in Washington DC, which should 
prove to be a fantastic venue to se- 
cure high-quality keynote speakers 
and assemble an excellent program. 
It will hopefully be convenient for 
many SlOPers to attend as well, so 
our goal is to break Division 14 at- 
tendance records at the convention 
in ‘14! 


Finally, I’d like to acknowledge the effort 
of Shonna Waters, as she recently 
wrapped up her tour of duty as APA Pro- 
gram Chair at the convention in Honolulu 
(tough one | know!). As you can imagine, 
this was not an easy program to assem- 


ble, given that SIOP 2014 is going to be 
held at the very exact place 9 months 
later. She put on a great program and 
made sure that SIOP was well- 
represented at the convention. To the 
SlOPers that attended, thanks for your 
contributions and commitment to the 
APA convention and | hope you managed 
to get some sun as well! If you have any 
comments or feedback about the conven- 
tion that will be helpful for next year’s 
planning, please send these through to 


me at autumn.krauss @sentis.net. 


Now we set our sights on DC for 2014. 

In the coming months, we will be fo- 
cused on making connections with other 
APA divisions and identifying collabora- 
tion opportunities for cross-divisional 
programming. We’ll also be preparing 
for our open submission process. Busy 
and exciting times ahead for the APA 
Program Committee, so if you would like 
to be involved in any capacity (e.g., have 
any idea for a cross-divisional session or 
invited session for our program), please 
consider joining our team. We’re going 
to have tons of fun and put on a super 
awesome program in DC! 
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Staying Connected to Your SIOP Community 


Zack Horn, Chair 
Electronic Communications Committee 


Staying up to date with SIOP and your 
fellow members is getting easier by the 
day. SIOP's Electronic Communications 
Committee (ECC) continues to acceler- 
ate its development of SIOP's online 
community, and has pulled together 
some new developments and social me- 
dia links in this article to help you stay 
connected. 


Get Started on my.SIOP 
in Only 10 Minutes 


The all-new my.SIOP Brochure is your 
quick guide to getting started with 
my.SIOP in 10 minutes! Watch the new 
my.SIOP Trailer for more on what 
my.SIOP is all about: 


Me erci i 


We sor; 
Sie for gp l neta. 
50P mor, Working 


my SIOP 


Set up Your my.SIOP Notifications 


Set up your Notification Settings to re- 
ceive email notices for my.SIOP activity 


that matters most to you! 
Make Yourself Searchable on my.SIOP 


Update your new SIOP profile so you can 
be found quickly by your SIOP peers: 
add your photo, tag your interests, link 
to your social media accounts, and get 


on the member map. Tailor your bio to 
link to your publication record, resume, 
or work history. 


Which my.SIOP Tools and Features Will 
You Find Helpful? 


Everyone has different goals and aspira- 
tions. Our goal at the ECC is to help you 
determine which features and tools will 
help enable you to achieve your goals 
within the SIOP Community. The 
my.SIOP Interactive Roadmap is your 
quick reference guide, but you can also 
learn more tips and discuss how you use 
these tools in these new my.SIOP Fo- 
rums: 


e Stay Updated 
e Find Collaborators 
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e Find Resources e SIOP on Facebook: Follow and post 


e Expand Your Network on SIOP's Facebook account 

e Build Your Presence e SIOP on LinkedIn: Join SIOP’s 

e Share Ideas LinkedIn Group to get updates and 
e Seek Opportunities join public discussions 


e Conference Toolkit 
The ECC is dedicated to continually ad- 
What to Follow and Share on Twitter, vancing your online experience as a SIOP 


Facebook, and LinkedIn: member, including these new commu- 
nity-based developments. Efforts to 
e @SIOPtweets: Follow the latest enhance and evolve the capabilities of 
from SIOP on Twitter my.SIOP are ongoing, and new develop- 
e @TheModernApp: Social media ments are being announced on SIOP's 
highlights for I-O psychologists Twitter, and Facebook, and my.SIOP 
e @TIP Editor: Latest from TIP Editor platforms. For any questions about 
Morrie Mullins my.SIOP or directed to the ECC, please 


e #my.SIOP: Use #my.SIOP on Twitter post to the my.SIOP User Forum or any 
to call attention to some great con- of the platforms above (#my.SIOP). 
tent or announcements about 
my.SIOP 
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Remembering Professor Emeritus H.G. (Bart) Osburn 


John Callender 


SIOP lost a consum- 
mate scientist— 
practitioner, 
teacher, and men- 
tor to a whole gen- 
eration of I-O psy- 
chologists when 
Bart Osburn passed 
away July 31, 2013 at age 91 in Norman, 
OK. The breadth and depth of his pro- 
fessional contributions are impressive by 
any measure. Following his University of 
Michigan PhD in 1952, Bart worked with 
the Army, and then HumRRO, on mili- 
tary research from 1953-57. He then 
served on the Southern Illinois Univer- 
sity faculty from 1957 until joining the 
University of Houston in 1960. He con- 
tinued teaching, advising, and publishing 
important work through 2000 after 
“officially” retiring in 1991. A Fellow of 
Divisions 5 and 14 and Diplomate in In- 
dustrial Psychology, he was named Pro- 
fessor Emeritus in 1999 and was further 
honored in 2000 when his students es- 
tablished the Bart Osburn Endowment 
for l-O Psychology. 


Bart’s vita reveals 49 publications, 43 tech- 
nical reports, and 39 papers presented to 
a variety of professional organizations. 
This body of work spanned many areas 


including psychological scale construction, 
configural test scoring methods, computer 
-aided teaching, computer -aided test con- 
struction, media effects on public atti- 
tudes, improving reliability coefficient ac- 
curacy, ethnic differences in test perform- 
ance, biographical form faking, behavior- 
ally anchored rating scales, validity gener- 
alization, improving interview validity, job 
characteristics that moderate validity, and 
validating physical strength requirements 
of jobs. In addition to his many contribu- 
tions to university committees and the 
Psychology Department, Bart even chaired 
the Computer Science Department one 
year. He consulted for 18 organizations 
including the VA, Peace Corp., retailers, 
home builders, hospitals, FedEx, and many 
energy companies, including long term 
relationships with Exxon and Shell, and 
their internships. 


Perhaps his greatest contribution lies in 
what he did to educate, encourage, sup- 
port, and guide a generation of people 
who he enabled to have successful ca- 
reers as academicians, practitioners, and 
consultants in I-O. He taught beginning 
and advanced statistics, psychometrics, 
and a variety of I-O topic seminars that 
grounded professionals in the essential 
knowledge needed to succeed. Bart 
chaired 20 masters theses and 31 doc- 
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toral dissertations from 1958 to 2000. 
His legacy continues in all those whom 
he helped with his unwavering support 
over the years. In his remembrance 
here is what students had to say: 


e For many, a dissertation is not a 
positive experience, but mine 
could not have been more enjoy- 
able. 

Bart was an incredible role model 
as a psychologist, teacher, mentor, 
and consultant, but more impor- 
tantly as an ethical, caring, princi- 
pled person who was funny, wise, 
stern when needed, and compas- 
sionate. 


Bart supported my application in 
spite of one low test score and 
gave me the chance to follow my 
dreams. 

He was patient and encouraging, 
and never condescending or critical. 
The great respect he engendered 
would drive you to want to be suc- 
cessful in your work with him. 

He had a quick mind and a quicker 
smile. 

He was the best as a professor, 
mentor and person that you could 
ask for, always available and lis- 
tening. 
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Transitions, New Affiliations, 
Appointments 


C. Allen Gorman will join the Depart- 
ment of Management and Marketing at 
East Tennessee State University in the 
fall, joining fellow SIOP member 
Lorianne Mitchell. After 3 years as the 
l-O master's program coordinator at 
Radford University, Allen will join ETSU 
as an assistant professor, teaching 
classes in OB and HR. 


Honors and Awards 


Dianna Stone was awarded the Sage 
Janet Chusmir Service Award by the 

Gender and Diversity Division of the 

Academy of Management in August, 
2013. 


IOTAS 


Chelsea Wymer 
Xavier University 


Steven Rogelberg was recently ap- 
pointed University Professor of UNC 
Charlotte. Dr. Rogelberg is the inaugural 
recipient of this appointment, which is 
based on scholarly achievement, as well 
as excellence in interdisciplinary re- 
search, teaching, and service. An article 
about the appointment can be read 
here. 


Good luck and congratulations! 


Keep your colleagues at SIOP up to date. 
Send items for lIOTAS to Morrie Mullins 


at mullins@xavier.edu. 
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SIOP Members in the News 


Clif Boutelle 


We are seeing more and more SIOP mem- 
bers writing articles for various outlets. In 
fact, the Administrative Office is periodi- 
cally contacted by various online and print 
publications, such as magazines, newspa- 
pers, newsletters, and trade journals, and 
asked if we have members willing to write 
about specific subjects. We are looking for 
members interested in writing articles for 
these publications. 


Generally when we think of the media, it 
is the major newspapers, magazines, 
and network radio and television that 
come to mind. Traditional print media 
remains important to any organization 
seeking to generate awareness about 
itself, but the Internet has created a 
whole new vista of outlets that should 
not be overlooked. In fact, more and 
more organizations, including SIOP, are 
developing social media strategies to tell 
their news. And a growing number of 
SIOP members are finding their way on 
to Internet sites because writers, 
whether mainstream media or on the 
Internet (often reporters are writing for 
both), still need credible resources. 


So, the opportunities for media mentions 
are expanding, and that is good for SIOP 
members and the field of I-O psychology. 
If you are willing to write an article, we 
look forward to hearing from you. 
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Following are some of the press men- 
tions, including online sites, that have 
occurred in the past several months: 


Sandra Davis of MDA Leadership Con- 
sulting in Minneapolis was quoted in a 
September 4 Wall Street Journal story 
about a successor to Steve Ballmer as 
CEO at Microsoft. Noting that Microsoft 
had previously established an ongoing 
strategy and a broad reorganization, 
Davis said it may be difficult to attract 
potential CEO candidates. “I can’t think 
of a CEO who doesn’t want to come in 
and say, let’s take a look at strategy,” 
Davis said. If the board is already aligned 
about a set of strategic decisions and 
the role a new CEO should play, “that is 
a very different kind of scenario to at- 
tract someone to,” she added. 


A story about workplace stress in the Sep- 
tember 4 Wall Street Journal referred to 
research by Theresa Glomb of the Univer- 
sity of Minnesota and colleagues. The 
study showed that workers reported 
lower stress levels after a day of work by 
spending a few minutes writing down the 
day’s positive events and why they made 
them feel good. Listing the good things 
that happened over the course of the day 
is valuable, she said, but the real impact 
comes from writing why those things led 
to good feelings. And, she added, the re- 


flections don’t have to be work related. 
Avoiding traffic jams on the way to work 
can be a workaday accomplishment. 


In an August 29 BBC Capital story about 
critical skills new hires lack noting 
greater emphasis upon interpersonal 
communication in business schools, 
Wendy Bedwell of the University of 
South Florida said. “Employers have put 
business schools on notice...they don’t 
want to hire people who can’t talk.” 
Schools should incorporate interper- 
sonal development in a variety of 
classes—from finance to operations— 
not just a few stand-alone communica- 
tion courses, she added. 


Tara Behrend of George Washington 
University contributed to an August 23 
Boston Globe story about discriminatory 
behavior in a society that favors attrac- 
tive people over the less attractive. 
When it comes to job interviews, 
Behrend pointed out there are evalua- 
tion methods that ignore differences in 
physical beauty. The field of industrial 
and organizational psychology has de- 
veloped a set of best practices for busi- 
nesses that want to avoid discrimination 
in hiring, including the use of online or 
standardized interviews that remove an 
interviewer’s unreliable gut instincts 
from the equation, she said. She ac- 
knowledged that a more systematic ap- 
proach can produce interviews that feel 
“less like a conversation and more like a 


test. But that means there’s less oppor- 
tunity for bias,” she said. 


Adam Grant of the University of Penn- 
sylvania’s Wharton School was men- 
tioned in several news articles in August 
and July. In an August 21 Fast Company 
story about understanding introverts 
and extroverts, Grant proffered a third 
personality category: ambiverts, those 
who exhibit extroverted and introverted 
tendencies, that is, in the middle of the 
two extremes. He said that being an am- 
bivert can actually be a good thing. For 
example, in a study, he found that am- 
biverts perform better in sales than ei- 
ther introverts or extroverts and closed 
24% more sales. 


An August 20 story in Forbes about how 
musicians are motivated by fans at their 
concerts, Grant’s research on several 
occupations showed that musicians 
were not alone in experiencing motiva- 
tional boosts from interactions with 
those who benefit from their work, in- 
cluding enjoying the music. He and his 
colleagues found that direct interaction 
with the people who benefit from their 
work increases employees’ productivity 
and helps sustain their motivation. 


The August 19 Huffington Post included 
a column authored by Grant urging rec- 
ognition in the workplace for go-givers, 
people who enjoy helping others with 
no strings attached. Go-givers, Grant 
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wrote, view money and power as incom- 
plete dimensions of success. Their suc- 
cess includes helping others, sharing 
their knowledge and creativity and pro- 
moting the well-being of coworkers. 


A similar story based upon Grant’s re- 
search about givers appeared in the July 
24 Forbes. He said workers who only 
look out for themselves are playing a 
short game. Whereas as those who lend 
a helping hand, even when they have 
nothing to gain, will reap long-term 
benefits, long after the favor has passed. 


Michael Woodward of Jersey City-based 
Human Capital Integrated was a guest 
on the August 14 Today Show and of- 
fered his thoughts on the secrets to find- 
ing success, which he described as a 
“relentless pursuit of passion. Set a vi- 
sion and go after it.” He also noted suc- 
cessful people often create a roadmap 
leading to success, and they define the 
process in order to eliminate detours. 


A study by Will Stoughton and Lori Fos- 
ter Thompson of North Carolina State 
University found that employers using 
Facebook to screen job applicants may 
be overlooking people who would be 
good employees. Their research was 
reported in several media outlets includ- 
ing the August 1 Monroe (LA) News Star 
and the July 22 issue of MacLean’s 
Magazine. Companies scan profiles to 
see whether there is evidence of drug or 
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alcohol use believing that such behavior 
means the applicant is not conscien- 
tious, responsible, or self-disciplined, 
said Foster Thompson. The study found 
no significant link between conscien- 
tiousness and a person’s Facebook post- 
ings. “This indicates some companies 
may be eliminating applicants based 
upon erroneous assumptions regarding 
what social media behavior tells us 
about the applicants,” said Stoughton. 


Paul Winum of RHR International 
(Atlanta) contributed to a May 15 Glass- 
door.com story about mistakes leaders 
should avoid in order to retain employ- 
ees. He noted that for many employees, 
career development and advancement 
are important to them and one of the 
main reasons for staying at the com- 
pany. But if the CEO and top manage- 
ment do not create a culture that en- 
ables people to move up, it will quickly 
be seen by employees, resulting in a 
high turnover rate. “In most companies, 
the success of the CEO and company is 
directly dependent on the caliber of tal- 
ent it is able to attract and retain,” 
Winum said. 


When a Chicago Tribune workplace col- 
umnist questioned the value of workplace 
surveys, he called upon Deborah Rupp of 
Purdue University for her view. She does- 
n’t think the workplace is being overana- 
lyzed. “Work is a pervasive part of the 
human experience, and people are work- 


ing more that they’re doing anything else, 
except perhaps sleeping,” she said. “All of 
this data we see are symbolic of organiza- 
tions paying more attention to the needs 
and health of workers that ever before. It 
used to be ‘How can we make you more 
productive.’ It wasn’t because you, as a 
human being, matter. Now the informa- 
tion we receive has a concern motive 
about it.” She concedes that some sur- 
veys are superfluous but added, “I think 
the public is able to differentiate between 
hokum and science.” 


Ben Dattner of Dattner Consulting in 
New York City wrote in the June 3 Har- 
vard Business Review Blog Network an 
article about making context count 
when conducting performance apprais- 
als. He noted that although almost every 
organization evaluates the performance 
of its employees, they do so differently. 
However, the one attribute that almost 
all performance appraisal systems have 
in common is they focus on the person 
not the situation. He wrote that organi- 
zations could achieve greater accuracy 
in evaluating employees’ performance 
by considering both the person and the 
work situation. Not doing so would be 
neither accurate nor fair to evaluate col- 
leagues with different work assignments 
on the same criteria using the same 
scale and reference points. 


Dattner was also featured in a May 31 
Marketplace story about overcoming 
workplace dilemmas. He said people 


should not let their feelings dictate their 
actions in the workplace. “It’s not always 
possible to make a workplace situation 
better, but it’s always possible to make it 
worse. So if you act, if you overreact, if 
you are too emotional, if you respond too 
quickly you can sometimes makes things 
worse.” Before responding, he said, it’s 
important to try to figure out what it is 
about the situation that is presenting a 
problem and making it difficult to handle. 


As companies strive for ways to recognize 
employees’ outstanding work, a survey 
from Bersin & Associates found that em- 
ployees find recognition from their peers 
to be more meaningful that traditional 
top-down acknowledgement from man- 
agement. That’s not surprising, says 
Lynda Zugec of The Workforce Consult- 
ants, with offices in New York City and 
Toronto, in a July 1 article in the New York 
Post. “Oftentimes management is un- 
aware of what employees are doing 
whereas employees deal with their col- 
leagues on a more regular basis.” She also 
mentioned the growing popularity of 
online platforms that allow workers to 
recognize the good work of their peers. 
“It stimulates conversation and lightheart- 
edness, creates a collaborative environ- 
ment, and goes a long way in developing 
an overall sense of fun,” she said. 


Zugec also contributed to an April MSN 
Careers story about how interviewees can 
spot “red flags” during an employment 
interview. For example, an interviewee 
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may ask why there have been more than one else in the organization can more 

two people in that particular job in the fully answer your question.” 

past 2 years and the interviewer skirts the 

question. “If you notice aninterviewer is Please let us know if you or a SIOP col- 
unprepared to openly answer a valid league have contributed to a news story. 
question, try asking it in different ways. We would like to include that mention in 
Inconsistent responses are a red flag that SIOP Members in the News. Send copies 
something may be happening behind the of the article to SIOP at boutelle@ 
scenes. Try to determine if the question is siop.org or fax to 419-352-2645. 

a deal breaker for you or whether some- 


at ea 4 
m 
m 
m OPPORTUNITIES FOR SIOP MEMBERS TO INCREASE m 
VISIBILITY OF I-O PSYCHOLOGY m 
m 
@ Periodically, the Administrative Office is contacted by various online and = 
m print publications, such as magazines, newspapers, newsletters and trade m 
Ææ journals, and asked if we have members willing to write about specific sub- = 
m jects. We are looking for members who would be interested in writing arti- | 
™ cles for these publications. m 
m 
m Please let us know, if you would like to write an occasional article for a m 
publication. Send your contact information as well as the subject matter m 
you would like to write about to boutelle@siop.org. We will then try to m 
m= match your expertise with a publication’s editorial needs when we receive m 
these requests. In addition, we will also be proactive in seeking opportuni- jæ 
m! ties for SIOP members to author articles in these publications. = 
m 
m Weare hoping that making these connections easy for our members will m 
increase the public’s awareness of the field of |-O psychology and the value ii 
m that we bring to employees and organizations. This work is being spear- m 
mæ headed by SIOP’s Visibility Committee in close conjunction with the SIOP m 
m Administrative Office. m 
m 
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Conferences and Meetings 


Please submit additional entries to David Pollack at David.Pollack@Sodexo.com. 


2013 


Sept. 30—Oct. 4 

Annual Conference of the Human Fac- 
tors and Ergonomics Society. 

San Diego, CA. Contact: The Human 
Factors and Ergonomics Society, 
www.hfes.org. (CE credit offered.) 


Oct. 14-19 

Annual Conference of the American 
Evaluation Association. Washington, DC. 
Contact: AEA, www.eval.org. 


Oct. 18-19 
SIOP Leading Edge Consortium. 
Richmond, VA. Contact: SIOP, 


www.siop.org/lec. (CE credit offered.) 


Oct. 25-26 

River Cities l-O Psychology Conference. 
Chattanooga, TN. Contact: http:// 
www.utc.edu/Academic/Industrial- 


OrganizationalPsychology/ 
RCIO2013.htm 


Oct. 28-Nov. 1 

Annual Conference of the International 
Military Testing Association. 

Seoul, South Korea. Contact: 
www.internationalmta.org. 


2014 


Jan. 8-10 

The British Psychological Society Division 
of Occupational Psychology Annual Con- 
ference. Brighton, UK. Contact: 


www.bps.org.uk/dop2014 


Feb. 20-23 

Annual Conference of the Society of Psy- 
chologists in Management (SPIM). 

New Orleans, LA. Contact: 
www.spim.org. (CE credit offered.) 


March 2-5 

Annual Innovations in Testing Confer- 
ence, Association of Test Publishers. 
Scottsdale, AZ. Contact: 


www. innovationsintesting.org. 


March 5-8 

Annual Conference of the Southeastern 
Psychological Association. 

Nashville, TN. Contact: SEPA, 


www.sepaonline.com. 
(CE credit offered.) 


March 14-18 

Annual Conference of the American So- 
ciety for Public Administration. 
Washington, DC. Contact: ASPA, 
www.aspanet.org 


October 2013 Volume 51 Issue 2 


April 2-6 

Annual Convention, National Council on 
Measurement in Education. Philadel- 
phia, PA. Contact: NCME, 
www.ncme.org. 


April 3-7 

Annual Convention, American Educa- 
tional Research Association. 
Philadelphia, PA. Contact: AERA, 
Www.aera.net. 


May 4-7 

Annual Conference of the American So- 
ciety for Training and Development. 
Washington, DC. Contact: ASTD, 
www.astd.org. 


May 15-17 

Annual Conference of the Society for 
Industrial and Organizational Psychol- 
ogy. Honolulu, HI. Contact: SIOP, 


siop2014.hawaiiconvention.com/ 
(CE credit offered.) 


May 22-25 

Annual Convention of the Association 
for Psychological Science. San Francisco, 
CA. Contact: APS, 


www.psychologicalscience.org. 
(CE credit offered.) 


June 5-7 

Annual Conference of the Canadian Soci- 
ety for Industrial and Organizational Psy- 
chology. Vancouver, BC. Contact: 


www.psychology.uwo.ca/csiop. 


June 22-25 

Annual Conference of the Society for 
Human Resource Management. 
Orlando, FL. Contact: SHRM, 
www.shrm.org. (CE credit offered.) 


July 8-13 

International Conference on Applied 
Psychology. Paris, France. 

Contact: www.icap2014.com. 


Aug. 1-5 

Annual Meeting of the Academy of Man- 
agement. Philadelphia, PA. 

Contact: Academy of Management, 
www.aomonline.org. 


Aug. 2-7 

Annual Convention of the American Sta- 
tistical Association. Boston, MA. 
Contact: ASA, www.amstat.org 

(CE credit offered.) 


Aug. 7—10 

Annual Convention of the American Psy- 
chological Association. Washington, DC. 
Contact: APA, www.apa.org (CE credit 
offered.) 
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